PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2025-12-05 12:55:37 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 12:55:37 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 12:55:37 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2025-12-05 12:55:37 [auto_selling_autotrader.co.uk] INFO: _job: 3175e3e0d1c111f0b120928152083da5, SCRAPY_JOB: None
2025-12-05 12:55:37 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 12:55:37 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 12:55:37 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 12:55:37 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 12:55:37 [scrapy.extensions.telnet] INFO: Telnet Password: 20aba7b3b0fc84d7
2025-12-05 12:55:37 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2025-12-05 12:55:37 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'CONCURRENT_REQUESTS': 5,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/3175e3e0d1c111f0b120928152083da5.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2025-12-05 12:55:37 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 12:55:37 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 12:55:37 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 12:55:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2025-12-05 12:55:37 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 12:55:37 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2025-12-05 12:55:37 [scrapy.core.engine] INFO: Spider opened
2025-12-05 12:55:37 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 12:55:37 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2025-12-05 12:55:37 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2025-12-05 12:55:37 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 12:55:37 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6031
2025-12-05 12:55:37 [scrapy-playwright] INFO: Starting download handler
2025-12-05 12:55:37 [scrapy-playwright] INFO: Starting download handler
2025-12-05 12:55:42 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10027005 and multipost_profile_id: 6e3537f2-914b-4000-b3a5-62ce744788b9 and job_id: 3175e3e0d1c111f0b120928152083da5 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=N70LU&retailerId=10027005&sort=price-asc
2025-12-05 12:55:42 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10027005, page: 1
2025-12-05 12:55:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Page: 1/2, total results: 38
2025-12-05 12:56:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:56:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305753%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512028305753: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512028305753, item: 202512028305753
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305675%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512028305675: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512028305675, item: 202512028305675
2025-12-05 12:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305568%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512028305568: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512028305568, item: 202512028305568
2025-12-05 12:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305544%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512028305544: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202512028305544, item: 202512028305544
2025-12-05 12:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138992%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258138992: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511258138992, item: 202511258138992
2025-12-05 12:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138891%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258138891: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511258138891, item: 202511258138891
2025-12-05 12:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138675%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258138675: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511258138675, item: 202511258138675
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138611%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258138611: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511258138611, item: 202511258138611
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258137869%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258137869: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511258137869, item: 202511258137869
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258137819%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258137819: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511258137819, item: 202511258137819
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258137783%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258137783: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511258137783, item: 202511258137783
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511238088216%27 HTTP/1.1" 200 None
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511238088216: 1
2025-12-05 12:56:03 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511238088216, item: 202511238088216
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208020722%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511208020722: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511208020722, item: 202511208020722
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921808%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157921808: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511157921808, item: 202511157921808
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921785%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157921785: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511157921785, item: 202511157921785
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921771%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157921771: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511157921771, item: 202511157921771
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921691%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157921691: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511157921691, item: 202511157921691
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921681%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157921681: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511157921681, item: 202511157921681
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511137879177%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511137879177: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202511137879177, item: 202511137879177
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317571711%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510317571711: 1
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202510317571711, item: 202510317571711
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10027005, page: 2
2025-12-05 12:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:04 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent runner, new mot, 12 months AA breakdown cover, '
'recently serviced,service history',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.2L',
'engine_horse_power': 74,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305544',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 159000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0dfcd0daf3264c7497f9f6896794b9b7.jpg',
'https://m.atcdn.co.uk/a/media/1d0992ba09d9491e8e55a0217cd70b55.jpg',
'https://m.atcdn.co.uk/a/media/92c0e572b81540cda99dc552f5faad0b.jpg',
'https://m.atcdn.co.uk/a/media/aeb7b07838144540b551e44603fdacd5.jpg',
'https://m.atcdn.co.uk/a/media/f0b9d409db554e499383815828350dcc.jpg',
'https://m.atcdn.co.uk/a/media/fa70a54cc5b74bb18cf42845851c5b27.jpg',
'https://m.atcdn.co.uk/a/media/ef7330b7f81b4ac3bbc8a6ff9d8b2a48.jpg',
'https://m.atcdn.co.uk/a/media/49b1eb87c90f416fa2111c876580ee3a.jpg',
'https://m.atcdn.co.uk/a/media/bda35755631d481e88959df2b74a50cb.jpg',
'https://m.atcdn.co.uk/a/media/ec682484a1924b108370328c465974b1.jpg',
'https://m.atcdn.co.uk/a/media/83c3d3e9385941a28dbbd17990349328.jpg'],
'price': 1699,
'price_includes_vat': True,
'registration_date': '2013-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TDI Match Edition Euro 5 5dr',
'transmission': 'manual',
'trim': 'Match Edition',
'year': 2013}
2025-12-05 12:56:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bcb4dd6-93b4-522c-a3b8-e9f90d13b815 with identifier: 202512028305544
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 9bcb4dd6-93b4-522c-a3b8-e9f90d13b815
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dfcd0daf3264c7497f9f6896794b9b7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dfcd0daf3264c7497f9f6896794b9b7.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1d0992ba09d9491e8e55a0217cd70b55.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1d0992ba09d9491e8e55a0217cd70b55.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92c0e572b81540cda99dc552f5faad0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92c0e572b81540cda99dc552f5faad0b.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faeb7b07838144540b551e44603fdacd5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aeb7b07838144540b551e44603fdacd5.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0b9d409db554e499383815828350dcc.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0b9d409db554e499383815828350dcc.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa70a54cc5b74bb18cf42845851c5b27.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa70a54cc5b74bb18cf42845851c5b27.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef7330b7f81b4ac3bbc8a6ff9d8b2a48.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef7330b7f81b4ac3bbc8a6ff9d8b2a48.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49b1eb87c90f416fa2111c876580ee3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49b1eb87c90f416fa2111c876580ee3a.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbda35755631d481e88959df2b74a50cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bda35755631d481e88959df2b74a50cb.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec682484a1924b108370328c465974b1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec682484a1924b108370328c465974b1.jpg already downloaded
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83c3d3e9385941a28dbbd17990349328.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83c3d3e9385941a28dbbd17990349328.jpg already downloaded
2025-12-05 12:56:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9bcb4dd6-93b4-522c-a3b8-e9f90d13b815 with identifier 202512028305544
2025-12-05 12:56:04 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2025-12-05 12:56:04 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2025-12-05 12:56:04 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2025-12-05 12:56:04 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2025-12-05 12:56:04 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2025-12-05 12:56:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 12:56:04 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 12:56:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 12:56:04 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 12:56:04 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2025-12-05 12:56:05 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2025-12-05 12:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:56:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1947
2025-12-05 12:56:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1764939365
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1764939365
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9bcb4dd6-93b4-522c-a3b8-e9f90d13b815
2025-12-05 12:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent runner, new mot, 12 months AA breakdown cover, '
'recently serviced,service history',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.2L',
'engine_horse_power': 74,
'fuel_type': 'Diesel',
'id': '9bcb4dd6-93b4-522c-a3b8-e9f90d13b815',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305544',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 159000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0dfcd0daf3264c7497f9f6896794b9b7.jpg',
'https://m.atcdn.co.uk/a/media/1d0992ba09d9491e8e55a0217cd70b55.jpg',
'https://m.atcdn.co.uk/a/media/92c0e572b81540cda99dc552f5faad0b.jpg',
'https://m.atcdn.co.uk/a/media/aeb7b07838144540b551e44603fdacd5.jpg',
'https://m.atcdn.co.uk/a/media/f0b9d409db554e499383815828350dcc.jpg',
'https://m.atcdn.co.uk/a/media/fa70a54cc5b74bb18cf42845851c5b27.jpg',
'https://m.atcdn.co.uk/a/media/ef7330b7f81b4ac3bbc8a6ff9d8b2a48.jpg',
'https://m.atcdn.co.uk/a/media/49b1eb87c90f416fa2111c876580ee3a.jpg',
'https://m.atcdn.co.uk/a/media/bda35755631d481e88959df2b74a50cb.jpg',
'https://m.atcdn.co.uk/a/media/ec682484a1924b108370328c465974b1.jpg',
'https://m.atcdn.co.uk/a/media/83c3d3e9385941a28dbbd17990349328.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306960,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dfcd0daf3264c7497f9f6896794b9b7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277853,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1d0992ba09d9491e8e55a0217cd70b55.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238789,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92c0e572b81540cda99dc552f5faad0b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301540,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aeb7b07838144540b551e44603fdacd5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236941,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0b9d409db554e499383815828350dcc.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218258,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa70a54cc5b74bb18cf42845851c5b27.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185238,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef7330b7f81b4ac3bbc8a6ff9d8b2a48.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225613,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/49b1eb87c90f416fa2111c876580ee3a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201900,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bda35755631d481e88959df2b74a50cb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183261,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec682484a1924b108370328c465974b1.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab79a63-65b3-5cae-9c99-0831ad7e3574/aab79a63-65b3-5cae-9c99-0831ad7e3574_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200486,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/83c3d3e9385941a28dbbd17990349328.jpg',
'Width': 1600}],
'price': 1699,
'price_includes_vat': True,
'registration_date': '2013-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TDI Match Edition Euro 5 5dr',
'transmission': 'manual',
'trim': 'Match Edition',
'year': 2013}
2025-12-05 12:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305544%27 HTTP/1.1" 200 None
2025-12-05 12:56:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512028305544: {'created_time': 1764939365.643043, 'last_price_update_time': 1764939365.643053}
2025-12-05 12:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512028305544') HTTP/1.1" 204 0
2025-12-05 12:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:06 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'Black',
'currency': 'GBP',
'description': 'New mot, recently serviced,service history, 2 keys, 12 months '
'AA breakdown cover,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 140,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305675',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Audi',
'model': 'A3',
'odometer': 124896,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/426732c48c6044db995345681a7c7d64.jpg',
'https://m.atcdn.co.uk/a/media/8fdd18f693d6499c901b360311361c37.jpg',
'https://m.atcdn.co.uk/a/media/09f3e016718e4010b96fe3433ddc285c.jpg',
'https://m.atcdn.co.uk/a/media/db60e8ab38bf4904914e54332b6c9d0c.jpg',
'https://m.atcdn.co.uk/a/media/cebd3a5112b44201b31e88fa7ec7b170.jpg',
'https://m.atcdn.co.uk/a/media/760f4de343354671a60e0513d799d8b5.jpg',
'https://m.atcdn.co.uk/a/media/319fc7a4a86b4bc7a0d6acc45299077a.jpg',
'https://m.atcdn.co.uk/a/media/8e528487b406496fb4ded9cdf9365888.jpg',
'https://m.atcdn.co.uk/a/media/a1c6ae59486b4eec8221e74725a8b871.jpg',
'https://m.atcdn.co.uk/a/media/26e9557dd53247e3a238c328e5606df5.jpg',
'https://m.atcdn.co.uk/a/media/5c7c4806c72844f1a04e9c64ce56be13.jpg',
'https://m.atcdn.co.uk/a/media/b6bc86a5f41c4693a983b2c2a2a90be1.jpg'],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2006-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 2.0 TDI Sport Sportback 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2006}
2025-12-05 12:56:06 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf2005e-fd15-5655-ac4e-581f1f0dbdf6 with identifier: 202512028305675
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 5bf2005e-fd15-5655-ac4e-581f1f0dbdf6
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F426732c48c6044db995345681a7c7d64.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/426732c48c6044db995345681a7c7d64.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8fdd18f693d6499c901b360311361c37.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8fdd18f693d6499c901b360311361c37.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09f3e016718e4010b96fe3433ddc285c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09f3e016718e4010b96fe3433ddc285c.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb60e8ab38bf4904914e54332b6c9d0c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db60e8ab38bf4904914e54332b6c9d0c.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcebd3a5112b44201b31e88fa7ec7b170.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cebd3a5112b44201b31e88fa7ec7b170.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F760f4de343354671a60e0513d799d8b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/760f4de343354671a60e0513d799d8b5.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F319fc7a4a86b4bc7a0d6acc45299077a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/319fc7a4a86b4bc7a0d6acc45299077a.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e528487b406496fb4ded9cdf9365888.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e528487b406496fb4ded9cdf9365888.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa1c6ae59486b4eec8221e74725a8b871.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a1c6ae59486b4eec8221e74725a8b871.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26e9557dd53247e3a238c328e5606df5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26e9557dd53247e3a238c328e5606df5.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c7c4806c72844f1a04e9c64ce56be13.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c7c4806c72844f1a04e9c64ce56be13.jpg already downloaded
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb6bc86a5f41c4693a983b2c2a2a90be1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b6bc86a5f41c4693a983b2c2a2a90be1.jpg already downloaded
2025-12-05 12:56:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5bf2005e-fd15-5655-ac4e-581f1f0dbdf6 with identifier 202512028305675
2025-12-05 12:56:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5bf2005e-fd15-5655-ac4e-581f1f0dbdf6
2025-12-05 12:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'Black',
'currency': 'GBP',
'description': 'New mot, recently serviced,service history, 2 keys, 12 months '
'AA breakdown cover,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 140,
'fuel_type': 'Diesel',
'id': '5bf2005e-fd15-5655-ac4e-581f1f0dbdf6',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305675',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Audi',
'model': 'A3',
'odometer': 124896,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/426732c48c6044db995345681a7c7d64.jpg',
'https://m.atcdn.co.uk/a/media/8fdd18f693d6499c901b360311361c37.jpg',
'https://m.atcdn.co.uk/a/media/09f3e016718e4010b96fe3433ddc285c.jpg',
'https://m.atcdn.co.uk/a/media/db60e8ab38bf4904914e54332b6c9d0c.jpg',
'https://m.atcdn.co.uk/a/media/cebd3a5112b44201b31e88fa7ec7b170.jpg',
'https://m.atcdn.co.uk/a/media/760f4de343354671a60e0513d799d8b5.jpg',
'https://m.atcdn.co.uk/a/media/319fc7a4a86b4bc7a0d6acc45299077a.jpg',
'https://m.atcdn.co.uk/a/media/8e528487b406496fb4ded9cdf9365888.jpg',
'https://m.atcdn.co.uk/a/media/a1c6ae59486b4eec8221e74725a8b871.jpg',
'https://m.atcdn.co.uk/a/media/26e9557dd53247e3a238c328e5606df5.jpg',
'https://m.atcdn.co.uk/a/media/5c7c4806c72844f1a04e9c64ce56be13.jpg',
'https://m.atcdn.co.uk/a/media/b6bc86a5f41c4693a983b2c2a2a90be1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255084,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/426732c48c6044db995345681a7c7d64.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277137,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8fdd18f693d6499c901b360311361c37.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275573,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09f3e016718e4010b96fe3433ddc285c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289264,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db60e8ab38bf4904914e54332b6c9d0c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204893,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cebd3a5112b44201b31e88fa7ec7b170.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288621,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/760f4de343354671a60e0513d799d8b5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236460,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/319fc7a4a86b4bc7a0d6acc45299077a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114001,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8e528487b406496fb4ded9cdf9365888.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167048,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a1c6ae59486b4eec8221e74725a8b871.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155314,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26e9557dd53247e3a238c328e5606df5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177115,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c7c4806c72844f1a04e9c64ce56be13.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e0f2698-6122-543c-bc61-67f2301efafd/7e0f2698-6122-543c-bc61-67f2301efafd_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143618,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b6bc86a5f41c4693a983b2c2a2a90be1.jpg',
'Width': 1600}],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2006-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 2.0 TDI Sport Sportback 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2006}
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305675%27 HTTP/1.1" 200 None
2025-12-05 12:56:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512028305675: {'created_time': 1764939366.258125, 'last_price_update_time': 1764939366.258138}
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512028305675') HTTP/1.1" 204 0
2025-12-05 12:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'Blue',
'currency': 'GBP',
'description': 'Clean car, excellent runner,top version,recently serviced, '
'service history,low tax and insurance group,comes with 3 '
'months warranty,12 months AA breakdown cover, we accept all '
'card payments,new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510317571711',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 79770,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/64753fbb4e5240bdb1d4509eec63831c.jpg',
'https://m.atcdn.co.uk/a/media/4353106fff984e26bc1a527d6c72aace.jpg',
'https://m.atcdn.co.uk/a/media/25d2b9439f984fb6b041550f1b3924c8.jpg',
'https://m.atcdn.co.uk/a/media/b0388bb5934140adb43959bfdc837fce.jpg',
'https://m.atcdn.co.uk/a/media/3479f972bb934c1190b9a54cb6966dd7.jpg',
'https://m.atcdn.co.uk/a/media/6d77bdb986e6456db0c9b33f840ae516.jpg',
'https://m.atcdn.co.uk/a/media/e975c1362e5145dcb16b28723a513f82.jpg',
'https://m.atcdn.co.uk/a/media/dad4f5f0ff7041aa81b08ff199e8151f.jpg',
'https://m.atcdn.co.uk/a/media/4bb2252d537145ad91f515112ff922ca.jpg',
'https://m.atcdn.co.uk/a/media/00c75c977d0943eeb553bf1cf515d97c.jpg',
'https://m.atcdn.co.uk/a/media/87e5f5b2ec614006aed4e1838bc33cad.jpg',
'https://m.atcdn.co.uk/a/media/98ea3458f49a4432b051200a3fba6f87.jpg',
'https://m.atcdn.co.uk/a/media/fc137021043540ada7b6edbf0db23ef3.jpg'],
'price': 2777,
'price_includes_vat': True,
'registration_date': '2011-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix20 1.4 Active Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2025-12-05 12:56:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d69a1f9-85ec-54c3-b904-2adcf132b653 with identifier: 202510317571711
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 9d69a1f9-85ec-54c3-b904-2adcf132b653
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F64753fbb4e5240bdb1d4509eec63831c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/64753fbb4e5240bdb1d4509eec63831c.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4353106fff984e26bc1a527d6c72aace.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4353106fff984e26bc1a527d6c72aace.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25d2b9439f984fb6b041550f1b3924c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25d2b9439f984fb6b041550f1b3924c8.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0388bb5934140adb43959bfdc837fce.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0388bb5934140adb43959bfdc837fce.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3479f972bb934c1190b9a54cb6966dd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3479f972bb934c1190b9a54cb6966dd7.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d77bdb986e6456db0c9b33f840ae516.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d77bdb986e6456db0c9b33f840ae516.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe975c1362e5145dcb16b28723a513f82.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e975c1362e5145dcb16b28723a513f82.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdad4f5f0ff7041aa81b08ff199e8151f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dad4f5f0ff7041aa81b08ff199e8151f.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bb2252d537145ad91f515112ff922ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bb2252d537145ad91f515112ff922ca.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00c75c977d0943eeb553bf1cf515d97c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00c75c977d0943eeb553bf1cf515d97c.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F87e5f5b2ec614006aed4e1838bc33cad.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/87e5f5b2ec614006aed4e1838bc33cad.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98ea3458f49a4432b051200a3fba6f87.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98ea3458f49a4432b051200a3fba6f87.jpg already downloaded
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc137021043540ada7b6edbf0db23ef3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc137021043540ada7b6edbf0db23ef3.jpg already downloaded
2025-12-05 12:56:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9d69a1f9-85ec-54c3-b904-2adcf132b653 with identifier 202510317571711
2025-12-05 12:56:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9d69a1f9-85ec-54c3-b904-2adcf132b653
2025-12-05 12:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'Blue',
'currency': 'GBP',
'description': 'Clean car, excellent runner,top version,recently serviced, '
'service history,low tax and insurance group,comes with 3 '
'months warranty,12 months AA breakdown cover, we accept all '
'card payments,new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': '9d69a1f9-85ec-54c3-b904-2adcf132b653',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510317571711',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 79770,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/64753fbb4e5240bdb1d4509eec63831c.jpg',
'https://m.atcdn.co.uk/a/media/4353106fff984e26bc1a527d6c72aace.jpg',
'https://m.atcdn.co.uk/a/media/25d2b9439f984fb6b041550f1b3924c8.jpg',
'https://m.atcdn.co.uk/a/media/b0388bb5934140adb43959bfdc837fce.jpg',
'https://m.atcdn.co.uk/a/media/3479f972bb934c1190b9a54cb6966dd7.jpg',
'https://m.atcdn.co.uk/a/media/6d77bdb986e6456db0c9b33f840ae516.jpg',
'https://m.atcdn.co.uk/a/media/e975c1362e5145dcb16b28723a513f82.jpg',
'https://m.atcdn.co.uk/a/media/dad4f5f0ff7041aa81b08ff199e8151f.jpg',
'https://m.atcdn.co.uk/a/media/4bb2252d537145ad91f515112ff922ca.jpg',
'https://m.atcdn.co.uk/a/media/00c75c977d0943eeb553bf1cf515d97c.jpg',
'https://m.atcdn.co.uk/a/media/87e5f5b2ec614006aed4e1838bc33cad.jpg',
'https://m.atcdn.co.uk/a/media/98ea3458f49a4432b051200a3fba6f87.jpg',
'https://m.atcdn.co.uk/a/media/fc137021043540ada7b6edbf0db23ef3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243132,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/64753fbb4e5240bdb1d4509eec63831c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223783,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4353106fff984e26bc1a527d6c72aace.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258450,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/25d2b9439f984fb6b041550f1b3924c8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238145,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0388bb5934140adb43959bfdc837fce.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269998,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3479f972bb934c1190b9a54cb6966dd7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236870,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d77bdb986e6456db0c9b33f840ae516.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109656,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e975c1362e5145dcb16b28723a513f82.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139562,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dad4f5f0ff7041aa81b08ff199e8151f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155932,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bb2252d537145ad91f515112ff922ca.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112536,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/00c75c977d0943eeb553bf1cf515d97c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175989,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/87e5f5b2ec614006aed4e1838bc33cad.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72711,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98ea3458f49a4432b051200a3fba6f87.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df62233e-4ed8-5953-8452-5b677607b501/df62233e-4ed8-5953-8452-5b677607b501_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152440,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc137021043540ada7b6edbf0db23ef3.jpg',
'Width': 1600}],
'price': 2777,
'price_includes_vat': True,
'registration_date': '2011-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix20 1.4 Active Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317571711%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510317571711: {'created_time': 1764939367.38993, 'last_price_update_time': 1764939367.389975}
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510317571711') HTTP/1.1" 204 0
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Page: 2/2, total results: 38
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510297502482%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510297502482: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202510297502482, item: 202510297502482
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510207293374%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510207293374: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202510207293374, item: 202510207293374
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510207293336%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510207293336: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202510207293336, item: 202510207293336
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510147152053%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510147152053: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202510147152053, item: 202510147152053
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510107065504%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510107065504: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202510107065504, item: 202510107065504
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510097033704%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510097033704: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202510097033704, item: 202510097033704
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306772283%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509306772283: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202509306772283, item: 202509306772283
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306772274%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509306772274: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202509306772274, item: 202509306772274
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306772232%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509306772232: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202509306772232, item: 202509306772232
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509166384985%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509166384985: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202509166384985, item: 202509166384985
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116258535%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509116258535: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202509116258535, item: 202509116258535
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116258293%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509116258293: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202509116258293, item: 202509116258293
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185552424%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508185552424: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202508185552424, item: 202508185552424
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508045136578%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508045136578: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202508045136578, item: 202508045136578
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506263901840%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506263901840: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202506263901840, item: 202506263901840
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506193683545%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506193683545: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202506193683545, item: 202506193683545
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506103353149%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506103353149: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202506103353149, item: 202506103353149
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505252798600%27 HTTP/1.1" 200 None
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202505252798600: 1
2025-12-05 12:56:07 [auto_selling_autotrader.co.uk] INFO: Getting details for advert ID: 202505252798600, item: 202505252798600
2025-12-05 12:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:08 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 155,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent runner, recently serviced,service history, 12 '
'months AA breakdown cover, new mot',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '1.5L',
'engine_horse_power': 95,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921681',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Mercedes-Benz',
'model': 'A Class',
'odometer': 98000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/01a4bad6ec2b4957a4730e1866cd79ab.jpg',
'https://m.atcdn.co.uk/a/media/b5922705317e41ad8ac612d3374a7e98.jpg',
'https://m.atcdn.co.uk/a/media/d95d177db7514517af1ca9d8abef56bc.jpg',
'https://m.atcdn.co.uk/a/media/92701bc6376640d9bc526ffa231ddba6.jpg',
'https://m.atcdn.co.uk/a/media/1d2a1ec5d0ea4f1fa0ca426b2064d36d.jpg',
'https://m.atcdn.co.uk/a/media/8bbc134812bb48978a88a1f6d3951727.jpg',
'https://m.atcdn.co.uk/a/media/36ccdd161d694cebbe7c926120f3bbd3.jpg',
'https://m.atcdn.co.uk/a/media/4e9275698b4b40ea95112b301f131498.jpg',
'https://m.atcdn.co.uk/a/media/49e59614caa0433e9d8476982f367ed3.jpg',
'https://m.atcdn.co.uk/a/media/d61cbd70579b42c6b7e5217eb5702857.jpg',
'https://m.atcdn.co.uk/a/media/1172db850d35432980bed067e750dd49.jpg',
'https://m.atcdn.co.uk/a/media/827f9cf197d0450e9350ca745b0223f7.jpg',
'https://m.atcdn.co.uk/a/media/965a273eaaa54ca5b3fc245680f60e9b.jpg'],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2008-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A Class 1.5 A150 Avantgarde SE 3dr',
'transmission': 'manual',
'trim': 'Avantgarde SE',
'year': 2008}
2025-12-05 12:56:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 27274931-ae41-52bb-812e-1bf860fd09e9 with identifier: 202511157921681
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 27274931-ae41-52bb-812e-1bf860fd09e9
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01a4bad6ec2b4957a4730e1866cd79ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01a4bad6ec2b4957a4730e1866cd79ab.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5922705317e41ad8ac612d3374a7e98.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5922705317e41ad8ac612d3374a7e98.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd95d177db7514517af1ca9d8abef56bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d95d177db7514517af1ca9d8abef56bc.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92701bc6376640d9bc526ffa231ddba6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92701bc6376640d9bc526ffa231ddba6.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1d2a1ec5d0ea4f1fa0ca426b2064d36d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1d2a1ec5d0ea4f1fa0ca426b2064d36d.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bbc134812bb48978a88a1f6d3951727.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bbc134812bb48978a88a1f6d3951727.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36ccdd161d694cebbe7c926120f3bbd3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36ccdd161d694cebbe7c926120f3bbd3.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e9275698b4b40ea95112b301f131498.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e9275698b4b40ea95112b301f131498.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49e59614caa0433e9d8476982f367ed3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49e59614caa0433e9d8476982f367ed3.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd61cbd70579b42c6b7e5217eb5702857.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d61cbd70579b42c6b7e5217eb5702857.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1172db850d35432980bed067e750dd49.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1172db850d35432980bed067e750dd49.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F827f9cf197d0450e9350ca745b0223f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/827f9cf197d0450e9350ca745b0223f7.jpg already downloaded
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F965a273eaaa54ca5b3fc245680f60e9b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/965a273eaaa54ca5b3fc245680f60e9b.jpg already downloaded
2025-12-05 12:56:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 27274931-ae41-52bb-812e-1bf860fd09e9 with identifier 202511157921681
2025-12-05 12:56:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 27274931-ae41-52bb-812e-1bf860fd09e9
2025-12-05 12:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 155,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent runner, recently serviced,service history, 12 '
'months AA breakdown cover, new mot',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '1.5L',
'engine_horse_power': 95,
'fuel_type': 'Petrol',
'id': '27274931-ae41-52bb-812e-1bf860fd09e9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921681',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Mercedes-Benz',
'model': 'A Class',
'odometer': 98000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/01a4bad6ec2b4957a4730e1866cd79ab.jpg',
'https://m.atcdn.co.uk/a/media/b5922705317e41ad8ac612d3374a7e98.jpg',
'https://m.atcdn.co.uk/a/media/d95d177db7514517af1ca9d8abef56bc.jpg',
'https://m.atcdn.co.uk/a/media/92701bc6376640d9bc526ffa231ddba6.jpg',
'https://m.atcdn.co.uk/a/media/1d2a1ec5d0ea4f1fa0ca426b2064d36d.jpg',
'https://m.atcdn.co.uk/a/media/8bbc134812bb48978a88a1f6d3951727.jpg',
'https://m.atcdn.co.uk/a/media/36ccdd161d694cebbe7c926120f3bbd3.jpg',
'https://m.atcdn.co.uk/a/media/4e9275698b4b40ea95112b301f131498.jpg',
'https://m.atcdn.co.uk/a/media/49e59614caa0433e9d8476982f367ed3.jpg',
'https://m.atcdn.co.uk/a/media/d61cbd70579b42c6b7e5217eb5702857.jpg',
'https://m.atcdn.co.uk/a/media/1172db850d35432980bed067e750dd49.jpg',
'https://m.atcdn.co.uk/a/media/827f9cf197d0450e9350ca745b0223f7.jpg',
'https://m.atcdn.co.uk/a/media/965a273eaaa54ca5b3fc245680f60e9b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468888,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/01a4bad6ec2b4957a4730e1866cd79ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441014,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5922705317e41ad8ac612d3374a7e98.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469252,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d95d177db7514517af1ca9d8abef56bc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503511,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92701bc6376640d9bc526ffa231ddba6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536910,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1d2a1ec5d0ea4f1fa0ca426b2064d36d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 511376,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8bbc134812bb48978a88a1f6d3951727.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410143,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/36ccdd161d694cebbe7c926120f3bbd3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457141,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e9275698b4b40ea95112b301f131498.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400201,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/49e59614caa0433e9d8476982f367ed3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323043,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d61cbd70579b42c6b7e5217eb5702857.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375804,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1172db850d35432980bed067e750dd49.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414800,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/827f9cf197d0450e9350ca745b0223f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a0dd60-0c6f-5703-9867-715d0ddc80f4/06a0dd60-0c6f-5703-9867-715d0ddc80f4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448263,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/965a273eaaa54ca5b3fc245680f60e9b.jpg',
'Width': 2048}],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2008-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A Class 1.5 A150 Avantgarde SE 3dr',
'transmission': 'manual',
'trim': 'Avantgarde SE',
'year': 2008}
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921681%27 HTTP/1.1" 200 None
2025-12-05 12:56:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157921681: {'created_time': 1764939368.333251, 'last_price_update_time': 1764939368.33326}
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157921681') HTTP/1.1" 204 0
2025-12-05 12:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:09 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent runner, top version,recently serviced,service '
'history, comes with 12 months AA breakdown cover,2 months '
'warranty,new mot , we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202505252798600',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 93530,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b2fb5fd71af241258e7a470ea0b7bfbb.jpg',
'https://m.atcdn.co.uk/a/media/6d13693422be4e8bb075d7e328e978e6.jpg',
'https://m.atcdn.co.uk/a/media/0272c4c8a4d14d33b4d538010d8b9354.jpg',
'https://m.atcdn.co.uk/a/media/2c1c9ed88ee14c7f88769d9cc6c8aaf5.jpg',
'https://m.atcdn.co.uk/a/media/b54ca815c10440e79a7690e726d5a755.jpg',
'https://m.atcdn.co.uk/a/media/be4decd5d7824718a1f1da8b1533564c.jpg',
'https://m.atcdn.co.uk/a/media/9d3d74f9b7de4ad09c19142922418bce.jpg',
'https://m.atcdn.co.uk/a/media/58c5a9c2604b44bf8394e8d510e94efb.jpg',
'https://m.atcdn.co.uk/a/media/7da92a33ba004653bf08e8ba92b2b449.jpg',
'https://m.atcdn.co.uk/a/media/e669e21ae9d747218391330703ee7393.jpg',
'https://m.atcdn.co.uk/a/media/bba098ebf76f4518999e5a9d92719198.jpg',
'https://m.atcdn.co.uk/a/media/ef23e07bc976415899f25f8f2dc4df1d.jpg',
'https://m.atcdn.co.uk/a/media/8b1b0baf5c054b7cb6789f798a5cefc5.jpg'],
'price': 2999,
'price_includes_vat': True,
'registration_date': '2013-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Mokka 1.6 S 2WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'S',
'year': 2013}
2025-12-05 12:56:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ebdcfc03-b551-5383-bb0b-715dad5441a2 with identifier: 202505252798600
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item ebdcfc03-b551-5383-bb0b-715dad5441a2
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb2fb5fd71af241258e7a470ea0b7bfbb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b2fb5fd71af241258e7a470ea0b7bfbb.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d13693422be4e8bb075d7e328e978e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d13693422be4e8bb075d7e328e978e6.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0272c4c8a4d14d33b4d538010d8b9354.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0272c4c8a4d14d33b4d538010d8b9354.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c1c9ed88ee14c7f88769d9cc6c8aaf5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c1c9ed88ee14c7f88769d9cc6c8aaf5.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb54ca815c10440e79a7690e726d5a755.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b54ca815c10440e79a7690e726d5a755.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbe4decd5d7824718a1f1da8b1533564c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/be4decd5d7824718a1f1da8b1533564c.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d3d74f9b7de4ad09c19142922418bce.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d3d74f9b7de4ad09c19142922418bce.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F58c5a9c2604b44bf8394e8d510e94efb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/58c5a9c2604b44bf8394e8d510e94efb.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7da92a33ba004653bf08e8ba92b2b449.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7da92a33ba004653bf08e8ba92b2b449.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe669e21ae9d747218391330703ee7393.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e669e21ae9d747218391330703ee7393.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbba098ebf76f4518999e5a9d92719198.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bba098ebf76f4518999e5a9d92719198.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef23e07bc976415899f25f8f2dc4df1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef23e07bc976415899f25f8f2dc4df1d.jpg already downloaded
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8b1b0baf5c054b7cb6789f798a5cefc5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8b1b0baf5c054b7cb6789f798a5cefc5.jpg already downloaded
2025-12-05 12:56:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ebdcfc03-b551-5383-bb0b-715dad5441a2 with identifier 202505252798600
2025-12-05 12:56:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ebdcfc03-b551-5383-bb0b-715dad5441a2
2025-12-05 12:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 153,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent runner, top version,recently serviced,service '
'history, comes with 12 months AA breakdown cover,2 months '
'warranty,new mot , we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'id': 'ebdcfc03-b551-5383-bb0b-715dad5441a2',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202505252798600',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 93530,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b2fb5fd71af241258e7a470ea0b7bfbb.jpg',
'https://m.atcdn.co.uk/a/media/6d13693422be4e8bb075d7e328e978e6.jpg',
'https://m.atcdn.co.uk/a/media/0272c4c8a4d14d33b4d538010d8b9354.jpg',
'https://m.atcdn.co.uk/a/media/2c1c9ed88ee14c7f88769d9cc6c8aaf5.jpg',
'https://m.atcdn.co.uk/a/media/b54ca815c10440e79a7690e726d5a755.jpg',
'https://m.atcdn.co.uk/a/media/be4decd5d7824718a1f1da8b1533564c.jpg',
'https://m.atcdn.co.uk/a/media/9d3d74f9b7de4ad09c19142922418bce.jpg',
'https://m.atcdn.co.uk/a/media/58c5a9c2604b44bf8394e8d510e94efb.jpg',
'https://m.atcdn.co.uk/a/media/7da92a33ba004653bf08e8ba92b2b449.jpg',
'https://m.atcdn.co.uk/a/media/e669e21ae9d747218391330703ee7393.jpg',
'https://m.atcdn.co.uk/a/media/bba098ebf76f4518999e5a9d92719198.jpg',
'https://m.atcdn.co.uk/a/media/ef23e07bc976415899f25f8f2dc4df1d.jpg',
'https://m.atcdn.co.uk/a/media/8b1b0baf5c054b7cb6789f798a5cefc5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221976,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b2fb5fd71af241258e7a470ea0b7bfbb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233787,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d13693422be4e8bb075d7e328e978e6.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262915,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0272c4c8a4d14d33b4d538010d8b9354.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228151,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c1c9ed88ee14c7f88769d9cc6c8aaf5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120760,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b54ca815c10440e79a7690e726d5a755.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140880,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/be4decd5d7824718a1f1da8b1533564c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198837,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d3d74f9b7de4ad09c19142922418bce.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145350,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/58c5a9c2604b44bf8394e8d510e94efb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177269,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7da92a33ba004653bf08e8ba92b2b449.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231021,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e669e21ae9d747218391330703ee7393.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246454,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bba098ebf76f4518999e5a9d92719198.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193087,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef23e07bc976415899f25f8f2dc4df1d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1b4181-8967-5fca-a708-238c9664b476/8c1b4181-8967-5fca-a708-238c9664b476_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225759,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8b1b0baf5c054b7cb6789f798a5cefc5.jpg',
'Width': 1600}],
'price': 2999,
'price_includes_vat': True,
'registration_date': '2013-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Mokka 1.6 S 2WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'S',
'year': 2013}
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505252798600%27 HTTP/1.1" 200 None
2025-12-05 12:56:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202505252798600: {'created_time': 1764939369.669801, 'last_price_update_time': 1764939369.669812}
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202505252798600') HTTP/1.1" 204 0
2025-12-05 12:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:11 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'Unknown',
'currency': 'GBP',
'description': 'Clean car,2 keys, low mileage, new mot, full service done,12 '
'months AA breakdown cover, 3 months warranty',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305753',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 40500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ea036e03780141f79f614c74b2ce4be8.jpg',
'https://m.atcdn.co.uk/a/media/48a1b2ea187c49ed89a48f2b15f85f13.jpg',
'https://m.atcdn.co.uk/a/media/88eea72f39af48b9ab0b1abb15aa801b.jpg',
'https://m.atcdn.co.uk/a/media/30ee9257552a497d89fdff9629030c55.jpg',
'https://m.atcdn.co.uk/a/media/501ef4289dc24c74bd009e84900c60c5.jpg',
'https://m.atcdn.co.uk/a/media/ac68edc9c39e41c5baa5502dd97c78ca.jpg',
'https://m.atcdn.co.uk/a/media/cf74bdf06ca946409f429e7a3d68b02f.jpg',
'https://m.atcdn.co.uk/a/media/dcd204d2080541378283b53cbfbf7028.jpg',
'https://m.atcdn.co.uk/a/media/1b212919bf0648108875138aef1c3a54.jpg',
'https://m.atcdn.co.uk/a/media/ade8b2e253b04dbf8136ae2b6246185f.jpg',
'https://m.atcdn.co.uk/a/media/68a7e7d26635473b9fb4520fc6895c27.jpg'],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2017-09-12',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix20 1.4 Blue Drive SE Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2025-12-05 12:56:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fcc8e0b-7c2e-5765-81b9-3470ed2b58f1 with identifier: 202512028305753
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 7fcc8e0b-7c2e-5765-81b9-3470ed2b58f1
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea036e03780141f79f614c74b2ce4be8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea036e03780141f79f614c74b2ce4be8.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48a1b2ea187c49ed89a48f2b15f85f13.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48a1b2ea187c49ed89a48f2b15f85f13.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F88eea72f39af48b9ab0b1abb15aa801b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/88eea72f39af48b9ab0b1abb15aa801b.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30ee9257552a497d89fdff9629030c55.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30ee9257552a497d89fdff9629030c55.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F501ef4289dc24c74bd009e84900c60c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/501ef4289dc24c74bd009e84900c60c5.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac68edc9c39e41c5baa5502dd97c78ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac68edc9c39e41c5baa5502dd97c78ca.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf74bdf06ca946409f429e7a3d68b02f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf74bdf06ca946409f429e7a3d68b02f.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdcd204d2080541378283b53cbfbf7028.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dcd204d2080541378283b53cbfbf7028.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b212919bf0648108875138aef1c3a54.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b212919bf0648108875138aef1c3a54.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fade8b2e253b04dbf8136ae2b6246185f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ade8b2e253b04dbf8136ae2b6246185f.jpg already downloaded
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68a7e7d26635473b9fb4520fc6895c27.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68a7e7d26635473b9fb4520fc6895c27.jpg already downloaded
2025-12-05 12:56:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7fcc8e0b-7c2e-5765-81b9-3470ed2b58f1 with identifier 202512028305753
2025-12-05 12:56:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7fcc8e0b-7c2e-5765-81b9-3470ed2b58f1
2025-12-05 12:56:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'Unknown',
'currency': 'GBP',
'description': 'Clean car,2 keys, low mileage, new mot, full service done,12 '
'months AA breakdown cover, 3 months warranty',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': '7fcc8e0b-7c2e-5765-81b9-3470ed2b58f1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305753',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 40500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ea036e03780141f79f614c74b2ce4be8.jpg',
'https://m.atcdn.co.uk/a/media/48a1b2ea187c49ed89a48f2b15f85f13.jpg',
'https://m.atcdn.co.uk/a/media/88eea72f39af48b9ab0b1abb15aa801b.jpg',
'https://m.atcdn.co.uk/a/media/30ee9257552a497d89fdff9629030c55.jpg',
'https://m.atcdn.co.uk/a/media/501ef4289dc24c74bd009e84900c60c5.jpg',
'https://m.atcdn.co.uk/a/media/ac68edc9c39e41c5baa5502dd97c78ca.jpg',
'https://m.atcdn.co.uk/a/media/cf74bdf06ca946409f429e7a3d68b02f.jpg',
'https://m.atcdn.co.uk/a/media/dcd204d2080541378283b53cbfbf7028.jpg',
'https://m.atcdn.co.uk/a/media/1b212919bf0648108875138aef1c3a54.jpg',
'https://m.atcdn.co.uk/a/media/ade8b2e253b04dbf8136ae2b6246185f.jpg',
'https://m.atcdn.co.uk/a/media/68a7e7d26635473b9fb4520fc6895c27.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231262,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea036e03780141f79f614c74b2ce4be8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249140,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48a1b2ea187c49ed89a48f2b15f85f13.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235382,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/88eea72f39af48b9ab0b1abb15aa801b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234432,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/30ee9257552a497d89fdff9629030c55.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240684,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/501ef4289dc24c74bd009e84900c60c5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214375,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac68edc9c39e41c5baa5502dd97c78ca.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220944,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf74bdf06ca946409f429e7a3d68b02f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109510,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dcd204d2080541378283b53cbfbf7028.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215554,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b212919bf0648108875138aef1c3a54.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249607,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ade8b2e253b04dbf8136ae2b6246185f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a97f49-3ff3-5cab-9f89-ef65290b60c4/36a97f49-3ff3-5cab-9f89-ef65290b60c4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234375,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/68a7e7d26635473b9fb4520fc6895c27.jpg',
'Width': 1600}],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2017-09-12',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix20 1.4 Blue Drive SE Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305753%27 HTTP/1.1" 200 None
2025-12-05 12:56:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512028305753: {'created_time': 1764939371.987252, 'last_price_update_time': 1764939371.987263}
2025-12-05 12:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512028305753') HTTP/1.1" 204 0
2025-12-05 12:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:17 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Red',
'currency': 'GBP',
'description': 'Very clean car, full service history, 2 keys, amazing '
'condition, top version, comes with new mot,3 months '
'warranty,12 months AA breakdown cover,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506103353149',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Astra',
'odometer': 33000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4575f0aeb55047178a55f2e544948672.jpg',
'https://m.atcdn.co.uk/a/media/68dc439c149349e69fbba9126df78cb8.jpg',
'https://m.atcdn.co.uk/a/media/7191fa9e4ea14a4680ab937e5ff45591.jpg',
'https://m.atcdn.co.uk/a/media/9cd96ece630a4d499078dafab0e53086.jpg',
'https://m.atcdn.co.uk/a/media/d1146ebea6cd487e95a0436b0a74d208.jpg',
'https://m.atcdn.co.uk/a/media/ac29ef8f13b7466590f194c439c6f2b9.jpg',
'https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg',
'https://m.atcdn.co.uk/a/media/3328c88bb4ab4f6bb020feae3e7da822.jpg',
'https://m.atcdn.co.uk/a/media/b49c051059114ebd9429f09cd9bf29b8.jpg',
'https://m.atcdn.co.uk/a/media/e38b0ee4adb348b3849340a6430418c9.jpg',
'https://m.atcdn.co.uk/a/media/9adfae06a62c410fa2b7b03eed282e97.jpg',
'https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg',
'https://m.atcdn.co.uk/a/media/78e88cc04c31402481e15e028ef42fa5.jpg'],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2019-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Astra 1.4i Turbo Griffin Euro 6 5dr',
'transmission': 'manual',
'trim': 'Griffin',
'year': 2019}
2025-12-05 12:56:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e9d480-d47e-52ae-9b8f-38bcc62ed959 with identifier: 202506103353149
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item f0e9d480-d47e-52ae-9b8f-38bcc62ed959
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4575f0aeb55047178a55f2e544948672.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4575f0aeb55047178a55f2e544948672.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68dc439c149349e69fbba9126df78cb8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68dc439c149349e69fbba9126df78cb8.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7191fa9e4ea14a4680ab937e5ff45591.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7191fa9e4ea14a4680ab937e5ff45591.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9cd96ece630a4d499078dafab0e53086.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9cd96ece630a4d499078dafab0e53086.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1146ebea6cd487e95a0436b0a74d208.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1146ebea6cd487e95a0436b0a74d208.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac29ef8f13b7466590f194c439c6f2b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac29ef8f13b7466590f194c439c6f2b9.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ebbfebbb2e14e6c9f3284688c6150a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3328c88bb4ab4f6bb020feae3e7da822.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3328c88bb4ab4f6bb020feae3e7da822.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb49c051059114ebd9429f09cd9bf29b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b49c051059114ebd9429f09cd9bf29b8.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe38b0ee4adb348b3849340a6430418c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e38b0ee4adb348b3849340a6430418c9.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9adfae06a62c410fa2b7b03eed282e97.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9adfae06a62c410fa2b7b03eed282e97.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ebbfebbb2e14e6c9f3284688c6150a4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg already downloaded
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78e88cc04c31402481e15e028ef42fa5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78e88cc04c31402481e15e028ef42fa5.jpg already downloaded
2025-12-05 12:56:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f0e9d480-d47e-52ae-9b8f-38bcc62ed959 with identifier 202506103353149
2025-12-05 12:56:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f0e9d480-d47e-52ae-9b8f-38bcc62ed959
2025-12-05 12:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Red',
'currency': 'GBP',
'description': 'Very clean car, full service history, 2 keys, amazing '
'condition, top version, comes with new mot,3 months '
'warranty,12 months AA breakdown cover,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': 'f0e9d480-d47e-52ae-9b8f-38bcc62ed959',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506103353149',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Astra',
'odometer': 33000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4575f0aeb55047178a55f2e544948672.jpg',
'https://m.atcdn.co.uk/a/media/68dc439c149349e69fbba9126df78cb8.jpg',
'https://m.atcdn.co.uk/a/media/7191fa9e4ea14a4680ab937e5ff45591.jpg',
'https://m.atcdn.co.uk/a/media/9cd96ece630a4d499078dafab0e53086.jpg',
'https://m.atcdn.co.uk/a/media/d1146ebea6cd487e95a0436b0a74d208.jpg',
'https://m.atcdn.co.uk/a/media/ac29ef8f13b7466590f194c439c6f2b9.jpg',
'https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg',
'https://m.atcdn.co.uk/a/media/3328c88bb4ab4f6bb020feae3e7da822.jpg',
'https://m.atcdn.co.uk/a/media/b49c051059114ebd9429f09cd9bf29b8.jpg',
'https://m.atcdn.co.uk/a/media/e38b0ee4adb348b3849340a6430418c9.jpg',
'https://m.atcdn.co.uk/a/media/9adfae06a62c410fa2b7b03eed282e97.jpg',
'https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg',
'https://m.atcdn.co.uk/a/media/78e88cc04c31402481e15e028ef42fa5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221291,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4575f0aeb55047178a55f2e544948672.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279353,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/68dc439c149349e69fbba9126df78cb8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210351,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7191fa9e4ea14a4680ab937e5ff45591.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248356,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9cd96ece630a4d499078dafab0e53086.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194786,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1146ebea6cd487e95a0436b0a74d208.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236988,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac29ef8f13b7466590f194c439c6f2b9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154431,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154431,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ebbfebbb2e14e6c9f3284688c6150a4.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160818,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3328c88bb4ab4f6bb020feae3e7da822.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153415,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b49c051059114ebd9429f09cd9bf29b8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120638,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e38b0ee4adb348b3849340a6430418c9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142266,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9adfae06a62c410fa2b7b03eed282e97.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94118da8-84e5-5691-b12d-0a281b630617/94118da8-84e5-5691-b12d-0a281b630617_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243412,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/78e88cc04c31402481e15e028ef42fa5.jpg',
'Width': 1600}],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2019-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Astra 1.4i Turbo Griffin Euro 6 5dr',
'transmission': 'manual',
'trim': 'Griffin',
'year': 2019}
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506103353149%27 HTTP/1.1" 200 None
2025-12-05 12:56:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506103353149: {'created_time': 1764939377.506001, 'last_price_update_time': 1764939377.506012}
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506103353149') HTTP/1.1" 204 0
2025-12-05 12:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:23 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'Orange',
'currency': 'GBP',
'description': 'Excellent condition,top version, full service history,2 keys, '
'amazing condition, comes with 3 months warranty,12 months AA '
'breakdown cover, new mot,we accept all card payments',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 134,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511137879177',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'MINI',
'model': 'Hatch',
'odometer': 65350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/510f9746e9c44dcea5ceeb618b547437.jpg',
'https://m.atcdn.co.uk/a/media/78cef7228b0349b28edebdf2056e347d.jpg',
'https://m.atcdn.co.uk/a/media/d0a95d1b0ffb4ba8b43945c615a7bbf5.jpg',
'https://m.atcdn.co.uk/a/media/bcb37e4073ac45a5a61d8cf794da0d21.jpg',
'https://m.atcdn.co.uk/a/media/de0894b52c87441394c810b5c3dc336e.jpg',
'https://m.atcdn.co.uk/a/media/30571a5cfda1495892c7f1372d3f2a85.jpg',
'https://m.atcdn.co.uk/a/media/be54c665d8684325bb72c46b5f37bfb1.jpg',
'https://m.atcdn.co.uk/a/media/32aa94d6a13a4fcb9c6fef2501e93e59.jpg',
'https://m.atcdn.co.uk/a/media/bba6837552054f0aa974dd994a757d8d.jpg'],
'price': 5399,
'price_includes_vat': True,
'registration_date': '2014-06-30',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Hatch 1.5 Cooper Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Cooper',
'year': 2014}
2025-12-05 12:56:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e58d3311-ba7d-53ae-a1ec-d1956491f129 with identifier: 202511137879177
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item e58d3311-ba7d-53ae-a1ec-d1956491f129
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F510f9746e9c44dcea5ceeb618b547437.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/510f9746e9c44dcea5ceeb618b547437.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78cef7228b0349b28edebdf2056e347d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78cef7228b0349b28edebdf2056e347d.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0a95d1b0ffb4ba8b43945c615a7bbf5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0a95d1b0ffb4ba8b43945c615a7bbf5.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbcb37e4073ac45a5a61d8cf794da0d21.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bcb37e4073ac45a5a61d8cf794da0d21.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde0894b52c87441394c810b5c3dc336e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de0894b52c87441394c810b5c3dc336e.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30571a5cfda1495892c7f1372d3f2a85.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30571a5cfda1495892c7f1372d3f2a85.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbe54c665d8684325bb72c46b5f37bfb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/be54c665d8684325bb72c46b5f37bfb1.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32aa94d6a13a4fcb9c6fef2501e93e59.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32aa94d6a13a4fcb9c6fef2501e93e59.jpg already downloaded
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbba6837552054f0aa974dd994a757d8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bba6837552054f0aa974dd994a757d8d.jpg already downloaded
2025-12-05 12:56:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e58d3311-ba7d-53ae-a1ec-d1956491f129 with identifier 202511137879177
2025-12-05 12:56:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e58d3311-ba7d-53ae-a1ec-d1956491f129
2025-12-05 12:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'Orange',
'currency': 'GBP',
'description': 'Excellent condition,top version, full service history,2 keys, '
'amazing condition, comes with 3 months warranty,12 months AA '
'breakdown cover, new mot,we accept all card payments',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 134,
'fuel_type': 'Petrol',
'id': 'e58d3311-ba7d-53ae-a1ec-d1956491f129',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511137879177',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'MINI',
'model': 'Hatch',
'odometer': 65350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photo_urls': ['https://m.atcdn.co.uk/a/media/510f9746e9c44dcea5ceeb618b547437.jpg',
'https://m.atcdn.co.uk/a/media/78cef7228b0349b28edebdf2056e347d.jpg',
'https://m.atcdn.co.uk/a/media/d0a95d1b0ffb4ba8b43945c615a7bbf5.jpg',
'https://m.atcdn.co.uk/a/media/bcb37e4073ac45a5a61d8cf794da0d21.jpg',
'https://m.atcdn.co.uk/a/media/de0894b52c87441394c810b5c3dc336e.jpg',
'https://m.atcdn.co.uk/a/media/30571a5cfda1495892c7f1372d3f2a85.jpg',
'https://m.atcdn.co.uk/a/media/be54c665d8684325bb72c46b5f37bfb1.jpg',
'https://m.atcdn.co.uk/a/media/32aa94d6a13a4fcb9c6fef2501e93e59.jpg',
'https://m.atcdn.co.uk/a/media/bba6837552054f0aa974dd994a757d8d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252618,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/510f9746e9c44dcea5ceeb618b547437.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264041,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/78cef7228b0349b28edebdf2056e347d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259062,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0a95d1b0ffb4ba8b43945c615a7bbf5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220553,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bcb37e4073ac45a5a61d8cf794da0d21.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117086,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/de0894b52c87441394c810b5c3dc336e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207307,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/30571a5cfda1495892c7f1372d3f2a85.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188892,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/be54c665d8684325bb72c46b5f37bfb1.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145577,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32aa94d6a13a4fcb9c6fef2501e93e59.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd008854-0f52-5918-a9c1-a046fffce835/dd008854-0f52-5918-a9c1-a046fffce835_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150625,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bba6837552054f0aa974dd994a757d8d.jpg',
'Width': 1600}],
'price': 5399,
'price_includes_vat': True,
'registration_date': '2014-06-30',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Hatch 1.5 Cooper Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Cooper',
'year': 2014}
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511137879177%27 HTTP/1.1" 200 None
2025-12-05 12:56:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511137879177: {'created_time': 1764939383.6075, 'last_price_update_time': 1764939383.607509}
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511137879177') HTTP/1.1" 204 0
2025-12-05 12:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:25 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent condition,full service history,2 keys, low mileage, '
'comes with 3 months warranty,12 months AA breakdown cover,new '
'mot',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508045136578',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Honda',
'model': 'CR-V',
'odometer': 45500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8f78d96f05ea4a46b7e8277368334e26.jpg',
'https://m.atcdn.co.uk/a/media/58175333885649678e6c501678b100ff.jpg',
'https://m.atcdn.co.uk/a/media/f0bd9ab0e8af43cb8cf12b53fe43e181.jpg',
'https://m.atcdn.co.uk/a/media/71ab8d028a7347648d3ab2cd8fc5a910.jpg',
'https://m.atcdn.co.uk/a/media/53272464fd6c435db53acabffaf065b8.jpg',
'https://m.atcdn.co.uk/a/media/b8fb9790f7ce4bc0b3eacab26eb3bc79.jpg',
'https://m.atcdn.co.uk/a/media/db4b2f7c1f6c45efb5eb4c5b40556a47.jpg',
'https://m.atcdn.co.uk/a/media/0a020b58cfb6473a803d8eed751f079f.jpg',
'https://m.atcdn.co.uk/a/media/2de411f9aeab44f8a9813f98ac479986.jpg',
'https://m.atcdn.co.uk/a/media/5b0605b7305f4644b1d745a73eb129c9.jpg',
'https://m.atcdn.co.uk/a/media/1ff405811aa548959de7c5aec4162e58.jpg',
'https://m.atcdn.co.uk/a/media/3185fac48cf541e49b8a127b16f602a7.jpg',
'https://m.atcdn.co.uk/a/media/9fd8e398907541dab883c7512831a088.jpg',
'https://m.atcdn.co.uk/a/media/0cee20da938245bbabf827d9b50c81f2.jpg',
'https://m.atcdn.co.uk/a/media/f84811f73c2a45bba4bb3e0e109c95e2.jpg',
'https://m.atcdn.co.uk/a/media/62ea14a050484ed4b6f76dd51c4e1492.jpg'],
'price': 12499,
'price_includes_vat': True,
'registration_date': '2017-11-03',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Cr-V 1.6 i-DTEC SE Plus Navi Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE Plus Navi',
'year': 2017}
2025-12-05 12:56:25 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: de760600-4471-5262-afa1-272719db89bb with identifier: 202508045136578
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item de760600-4471-5262-afa1-272719db89bb
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f78d96f05ea4a46b7e8277368334e26.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f78d96f05ea4a46b7e8277368334e26.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F58175333885649678e6c501678b100ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/58175333885649678e6c501678b100ff.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0bd9ab0e8af43cb8cf12b53fe43e181.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0bd9ab0e8af43cb8cf12b53fe43e181.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71ab8d028a7347648d3ab2cd8fc5a910.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71ab8d028a7347648d3ab2cd8fc5a910.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53272464fd6c435db53acabffaf065b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53272464fd6c435db53acabffaf065b8.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8fb9790f7ce4bc0b3eacab26eb3bc79.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8fb9790f7ce4bc0b3eacab26eb3bc79.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb4b2f7c1f6c45efb5eb4c5b40556a47.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db4b2f7c1f6c45efb5eb4c5b40556a47.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a020b58cfb6473a803d8eed751f079f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a020b58cfb6473a803d8eed751f079f.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2de411f9aeab44f8a9813f98ac479986.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2de411f9aeab44f8a9813f98ac479986.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b0605b7305f4644b1d745a73eb129c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b0605b7305f4644b1d745a73eb129c9.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1ff405811aa548959de7c5aec4162e58.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1ff405811aa548959de7c5aec4162e58.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3185fac48cf541e49b8a127b16f602a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3185fac48cf541e49b8a127b16f602a7.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9fd8e398907541dab883c7512831a088.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9fd8e398907541dab883c7512831a088.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0cee20da938245bbabf827d9b50c81f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0cee20da938245bbabf827d9b50c81f2.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff84811f73c2a45bba4bb3e0e109c95e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f84811f73c2a45bba4bb3e0e109c95e2.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62ea14a050484ed4b6f76dd51c4e1492.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62ea14a050484ed4b6f76dd51c4e1492.jpg already downloaded
2025-12-05 12:56:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: de760600-4471-5262-afa1-272719db89bb with identifier 202508045136578
2025-12-05 12:56:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item de760600-4471-5262-afa1-272719db89bb
2025-12-05 12:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent condition,full service history,2 keys, low mileage, '
'comes with 3 months warranty,12 months AA breakdown cover,new '
'mot',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'id': 'de760600-4471-5262-afa1-272719db89bb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508045136578',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Honda',
'model': 'CR-V',
'odometer': 45500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8f78d96f05ea4a46b7e8277368334e26.jpg',
'https://m.atcdn.co.uk/a/media/58175333885649678e6c501678b100ff.jpg',
'https://m.atcdn.co.uk/a/media/f0bd9ab0e8af43cb8cf12b53fe43e181.jpg',
'https://m.atcdn.co.uk/a/media/71ab8d028a7347648d3ab2cd8fc5a910.jpg',
'https://m.atcdn.co.uk/a/media/53272464fd6c435db53acabffaf065b8.jpg',
'https://m.atcdn.co.uk/a/media/b8fb9790f7ce4bc0b3eacab26eb3bc79.jpg',
'https://m.atcdn.co.uk/a/media/db4b2f7c1f6c45efb5eb4c5b40556a47.jpg',
'https://m.atcdn.co.uk/a/media/0a020b58cfb6473a803d8eed751f079f.jpg',
'https://m.atcdn.co.uk/a/media/2de411f9aeab44f8a9813f98ac479986.jpg',
'https://m.atcdn.co.uk/a/media/5b0605b7305f4644b1d745a73eb129c9.jpg',
'https://m.atcdn.co.uk/a/media/1ff405811aa548959de7c5aec4162e58.jpg',
'https://m.atcdn.co.uk/a/media/3185fac48cf541e49b8a127b16f602a7.jpg',
'https://m.atcdn.co.uk/a/media/9fd8e398907541dab883c7512831a088.jpg',
'https://m.atcdn.co.uk/a/media/0cee20da938245bbabf827d9b50c81f2.jpg',
'https://m.atcdn.co.uk/a/media/f84811f73c2a45bba4bb3e0e109c95e2.jpg',
'https://m.atcdn.co.uk/a/media/62ea14a050484ed4b6f76dd51c4e1492.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240631,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f78d96f05ea4a46b7e8277368334e26.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245305,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/58175333885649678e6c501678b100ff.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232245,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0bd9ab0e8af43cb8cf12b53fe43e181.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258206,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/71ab8d028a7347648d3ab2cd8fc5a910.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258588,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53272464fd6c435db53acabffaf065b8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188224,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b8fb9790f7ce4bc0b3eacab26eb3bc79.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212510,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db4b2f7c1f6c45efb5eb4c5b40556a47.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103262,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a020b58cfb6473a803d8eed751f079f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99136,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2de411f9aeab44f8a9813f98ac479986.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164439,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5b0605b7305f4644b1d745a73eb129c9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147550,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1ff405811aa548959de7c5aec4162e58.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126212,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3185fac48cf541e49b8a127b16f602a7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182151,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9fd8e398907541dab883c7512831a088.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313376,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0cee20da938245bbabf827d9b50c81f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352453,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f84811f73c2a45bba4bb3e0e109c95e2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a24f2232-77b6-580a-ae0c-547a5e4e38e2/a24f2232-77b6-580a-ae0c-547a5e4e38e2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308398,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62ea14a050484ed4b6f76dd51c4e1492.jpg',
'Width': 2048}],
'price': 12499,
'price_includes_vat': True,
'registration_date': '2017-11-03',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Cr-V 1.6 i-DTEC SE Plus Navi Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE Plus Navi',
'year': 2017}
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508045136578%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508045136578: {'created_time': 1764939385.402543, 'last_price_update_time': 1764939385.402556}
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508045136578') HTTP/1.1" 204 0
2025-12-05 12:56:25 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'Unknown',
'currency': 'GBP',
'description': 'Excellent runner,amazing condition, top version,automatic, '
'hybrid,2 keys, full service done, comes with 3 months '
'warranty,12 months AA breakdown cover, new mot, we accept all '
'card payments',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 184,
'fuel_type': 'Petrol Hybrid',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506263901840',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 73000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c59a31b43e294cfe88652edba3466bf1.jpg',
'https://m.atcdn.co.uk/a/media/88b465980fe74197828e274bfea8ed92.jpg',
'https://m.atcdn.co.uk/a/media/9162705b404a475db5aad4bdbc134b17.jpg',
'https://m.atcdn.co.uk/a/media/ff2ff96c7cdd4899aafd4a5fae0651a8.jpg',
'https://m.atcdn.co.uk/a/media/e1dbd4e19a9e47c086492462560eb364.jpg',
'https://m.atcdn.co.uk/a/media/98a4bb8d55bf44b78627543c959fa14c.jpg',
'https://m.atcdn.co.uk/a/media/74e3757082484584a935aa36c3bca356.jpg',
'https://m.atcdn.co.uk/a/media/ab008c67ab2141959a5b7bc24c8bc5c9.jpg',
'https://m.atcdn.co.uk/a/media/a0de621f12aa46918a67e21ff3439018.jpg',
'https://m.atcdn.co.uk/a/media/6b9ca5aac36446f2a00912de7f543a56.jpg',
'https://m.atcdn.co.uk/a/media/c63c0c8eceb9415996df21e896ca2da6.jpg',
'https://m.atcdn.co.uk/a/media/33dd290f8c924e4994d462e3f67e776f.jpg',
'https://m.atcdn.co.uk/a/media/9cb40e9d83a84c84837e57911272b341.jpg',
'https://m.atcdn.co.uk/a/media/32e31ac32e374be69654243c82f4a612.jpg'],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2018-03-12',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Mondeo 2.0 TiVCT ST-Line Edition CVT Euro 6 (s/s) 4dr',
'transmission': 'automatic',
'trim': 'ST-Line Edition',
'year': 2019}
2025-12-05 12:56:25 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 141d2167-c055-56c6-b297-454a5bb1cef3 with identifier: 202506263901840
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 141d2167-c055-56c6-b297-454a5bb1cef3
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc59a31b43e294cfe88652edba3466bf1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c59a31b43e294cfe88652edba3466bf1.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F88b465980fe74197828e274bfea8ed92.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/88b465980fe74197828e274bfea8ed92.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9162705b404a475db5aad4bdbc134b17.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9162705b404a475db5aad4bdbc134b17.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff2ff96c7cdd4899aafd4a5fae0651a8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff2ff96c7cdd4899aafd4a5fae0651a8.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe1dbd4e19a9e47c086492462560eb364.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e1dbd4e19a9e47c086492462560eb364.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98a4bb8d55bf44b78627543c959fa14c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98a4bb8d55bf44b78627543c959fa14c.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F74e3757082484584a935aa36c3bca356.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/74e3757082484584a935aa36c3bca356.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab008c67ab2141959a5b7bc24c8bc5c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab008c67ab2141959a5b7bc24c8bc5c9.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0de621f12aa46918a67e21ff3439018.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0de621f12aa46918a67e21ff3439018.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b9ca5aac36446f2a00912de7f543a56.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b9ca5aac36446f2a00912de7f543a56.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc63c0c8eceb9415996df21e896ca2da6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c63c0c8eceb9415996df21e896ca2da6.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33dd290f8c924e4994d462e3f67e776f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33dd290f8c924e4994d462e3f67e776f.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9cb40e9d83a84c84837e57911272b341.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9cb40e9d83a84c84837e57911272b341.jpg already downloaded
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32e31ac32e374be69654243c82f4a612.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32e31ac32e374be69654243c82f4a612.jpg already downloaded
2025-12-05 12:56:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 141d2167-c055-56c6-b297-454a5bb1cef3 with identifier 202506263901840
2025-12-05 12:56:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 141d2167-c055-56c6-b297-454a5bb1cef3
2025-12-05 12:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'Unknown',
'currency': 'GBP',
'description': 'Excellent runner,amazing condition, top version,automatic, '
'hybrid,2 keys, full service done, comes with 3 months '
'warranty,12 months AA breakdown cover, new mot, we accept all '
'card payments',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 184,
'fuel_type': 'Petrol Hybrid',
'id': '141d2167-c055-56c6-b297-454a5bb1cef3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506263901840',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 73000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c59a31b43e294cfe88652edba3466bf1.jpg',
'https://m.atcdn.co.uk/a/media/88b465980fe74197828e274bfea8ed92.jpg',
'https://m.atcdn.co.uk/a/media/9162705b404a475db5aad4bdbc134b17.jpg',
'https://m.atcdn.co.uk/a/media/ff2ff96c7cdd4899aafd4a5fae0651a8.jpg',
'https://m.atcdn.co.uk/a/media/e1dbd4e19a9e47c086492462560eb364.jpg',
'https://m.atcdn.co.uk/a/media/98a4bb8d55bf44b78627543c959fa14c.jpg',
'https://m.atcdn.co.uk/a/media/74e3757082484584a935aa36c3bca356.jpg',
'https://m.atcdn.co.uk/a/media/ab008c67ab2141959a5b7bc24c8bc5c9.jpg',
'https://m.atcdn.co.uk/a/media/a0de621f12aa46918a67e21ff3439018.jpg',
'https://m.atcdn.co.uk/a/media/6b9ca5aac36446f2a00912de7f543a56.jpg',
'https://m.atcdn.co.uk/a/media/c63c0c8eceb9415996df21e896ca2da6.jpg',
'https://m.atcdn.co.uk/a/media/33dd290f8c924e4994d462e3f67e776f.jpg',
'https://m.atcdn.co.uk/a/media/9cb40e9d83a84c84837e57911272b341.jpg',
'https://m.atcdn.co.uk/a/media/32e31ac32e374be69654243c82f4a612.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270093,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c59a31b43e294cfe88652edba3466bf1.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232888,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/88b465980fe74197828e274bfea8ed92.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265625,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9162705b404a475db5aad4bdbc134b17.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324619,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff2ff96c7cdd4899aafd4a5fae0651a8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307536,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e1dbd4e19a9e47c086492462560eb364.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276187,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98a4bb8d55bf44b78627543c959fa14c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224568,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/74e3757082484584a935aa36c3bca356.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214883,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab008c67ab2141959a5b7bc24c8bc5c9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209718,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0de621f12aa46918a67e21ff3439018.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201158,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b9ca5aac36446f2a00912de7f543a56.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180733,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c63c0c8eceb9415996df21e896ca2da6.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196789,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/33dd290f8c924e4994d462e3f67e776f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81607,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9cb40e9d83a84c84837e57911272b341.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c58fbe-0fbb-5ab8-8d0c-85296631f55a/45c58fbe-0fbb-5ab8-8d0c-85296631f55a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171671,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32e31ac32e374be69654243c82f4a612.jpg',
'Width': 1600}],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2018-03-12',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Mondeo 2.0 TiVCT ST-Line Edition CVT Euro 6 (s/s) 4dr',
'transmission': 'automatic',
'trim': 'ST-Line Edition',
'year': 2019}
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506263901840%27 HTTP/1.1" 200 None
2025-12-05 12:56:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506263901840: {'created_time': 1764939385.712116, 'last_price_update_time': 1764939385.712125}
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506263901840') HTTP/1.1" 204 0
2025-12-05 12:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:33 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,2 keys, new '
'mot, 12 months AA breakdown cover, 3 months warranty',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508185552424',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Range Rover Evoque',
'odometer': 71108,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/748ec22026b341e39b7a92939d12a899.jpg',
'https://m.atcdn.co.uk/a/media/850cf5ad48864f20bdc524acd3957dcf.jpg',
'https://m.atcdn.co.uk/a/media/5f7de2f749cc45239eb798f8d2d687a9.jpg',
'https://m.atcdn.co.uk/a/media/b54f6b460ac7441aabaa7f83c9ef2722.jpg',
'https://m.atcdn.co.uk/a/media/b8b1587491224448859f1578c41d3bd7.jpg',
'https://m.atcdn.co.uk/a/media/881a48947e8744faa2a0d89226879201.jpg',
'https://m.atcdn.co.uk/a/media/63c583f30d5b4d95867eb23ed95cf32b.jpg',
'https://m.atcdn.co.uk/a/media/5047a2ed88fd4b6c8db7524a1a7a50da.jpg',
'https://m.atcdn.co.uk/a/media/01f3450bc6f14373adca3c4a063a10e5.jpg',
'https://m.atcdn.co.uk/a/media/57d461efdd8e49ea96beed03237883a3.jpg',
'https://m.atcdn.co.uk/a/media/c622122101514054b8548a8f85e522b5.jpg',
'https://m.atcdn.co.uk/a/media/9336fef788f84e3586cef654eb037b36.jpg',
'https://m.atcdn.co.uk/a/media/f4cd54c95f0a4d4b9eff90e26b32d059.jpg',
'https://m.atcdn.co.uk/a/media/b7ff2d76caa6474191219f41a5063038.jpg',
'https://m.atcdn.co.uk/a/media/0dc7d7dccaa246deb9cb22c080a5249f.jpg',
'https://m.atcdn.co.uk/a/media/e3dae1984ddd4964b015fda58bc38d04.jpg'],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2015-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque 2.2 SD4 Dynamic 4WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2015}
2025-12-05 12:56:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b9dd05-ac7a-54be-b561-f4fb3d08cbff with identifier: 202508185552424
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 70b9dd05-ac7a-54be-b561-f4fb3d08cbff
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F748ec22026b341e39b7a92939d12a899.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/748ec22026b341e39b7a92939d12a899.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F850cf5ad48864f20bdc524acd3957dcf.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/850cf5ad48864f20bdc524acd3957dcf.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f7de2f749cc45239eb798f8d2d687a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f7de2f749cc45239eb798f8d2d687a9.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb54f6b460ac7441aabaa7f83c9ef2722.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b54f6b460ac7441aabaa7f83c9ef2722.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8b1587491224448859f1578c41d3bd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8b1587491224448859f1578c41d3bd7.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F881a48947e8744faa2a0d89226879201.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/881a48947e8744faa2a0d89226879201.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63c583f30d5b4d95867eb23ed95cf32b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63c583f30d5b4d95867eb23ed95cf32b.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5047a2ed88fd4b6c8db7524a1a7a50da.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5047a2ed88fd4b6c8db7524a1a7a50da.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01f3450bc6f14373adca3c4a063a10e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01f3450bc6f14373adca3c4a063a10e5.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F57d461efdd8e49ea96beed03237883a3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/57d461efdd8e49ea96beed03237883a3.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc622122101514054b8548a8f85e522b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c622122101514054b8548a8f85e522b5.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9336fef788f84e3586cef654eb037b36.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9336fef788f84e3586cef654eb037b36.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4cd54c95f0a4d4b9eff90e26b32d059.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4cd54c95f0a4d4b9eff90e26b32d059.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7ff2d76caa6474191219f41a5063038.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7ff2d76caa6474191219f41a5063038.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dc7d7dccaa246deb9cb22c080a5249f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dc7d7dccaa246deb9cb22c080a5249f.jpg already downloaded
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe3dae1984ddd4964b015fda58bc38d04.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e3dae1984ddd4964b015fda58bc38d04.jpg already downloaded
2025-12-05 12:56:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 70b9dd05-ac7a-54be-b561-f4fb3d08cbff with identifier 202508185552424
2025-12-05 12:56:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 70b9dd05-ac7a-54be-b561-f4fb3d08cbff
2025-12-05 12:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,2 keys, new '
'mot, 12 months AA breakdown cover, 3 months warranty',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': '70b9dd05-ac7a-54be-b561-f4fb3d08cbff',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508185552424',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Range Rover Evoque',
'odometer': 71108,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://m.atcdn.co.uk/a/media/748ec22026b341e39b7a92939d12a899.jpg',
'https://m.atcdn.co.uk/a/media/850cf5ad48864f20bdc524acd3957dcf.jpg',
'https://m.atcdn.co.uk/a/media/5f7de2f749cc45239eb798f8d2d687a9.jpg',
'https://m.atcdn.co.uk/a/media/b54f6b460ac7441aabaa7f83c9ef2722.jpg',
'https://m.atcdn.co.uk/a/media/b8b1587491224448859f1578c41d3bd7.jpg',
'https://m.atcdn.co.uk/a/media/881a48947e8744faa2a0d89226879201.jpg',
'https://m.atcdn.co.uk/a/media/63c583f30d5b4d95867eb23ed95cf32b.jpg',
'https://m.atcdn.co.uk/a/media/5047a2ed88fd4b6c8db7524a1a7a50da.jpg',
'https://m.atcdn.co.uk/a/media/01f3450bc6f14373adca3c4a063a10e5.jpg',
'https://m.atcdn.co.uk/a/media/57d461efdd8e49ea96beed03237883a3.jpg',
'https://m.atcdn.co.uk/a/media/c622122101514054b8548a8f85e522b5.jpg',
'https://m.atcdn.co.uk/a/media/9336fef788f84e3586cef654eb037b36.jpg',
'https://m.atcdn.co.uk/a/media/f4cd54c95f0a4d4b9eff90e26b32d059.jpg',
'https://m.atcdn.co.uk/a/media/b7ff2d76caa6474191219f41a5063038.jpg',
'https://m.atcdn.co.uk/a/media/0dc7d7dccaa246deb9cb22c080a5249f.jpg',
'https://m.atcdn.co.uk/a/media/e3dae1984ddd4964b015fda58bc38d04.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204805,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/748ec22026b341e39b7a92939d12a899.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221856,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/850cf5ad48864f20bdc524acd3957dcf.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228020,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f7de2f749cc45239eb798f8d2d687a9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78662,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b54f6b460ac7441aabaa7f83c9ef2722.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254518,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b8b1587491224448859f1578c41d3bd7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255894,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/881a48947e8744faa2a0d89226879201.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241971,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/63c583f30d5b4d95867eb23ed95cf32b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229206,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5047a2ed88fd4b6c8db7524a1a7a50da.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296295,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/01f3450bc6f14373adca3c4a063a10e5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209496,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/57d461efdd8e49ea96beed03237883a3.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141491,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c622122101514054b8548a8f85e522b5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84890,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9336fef788f84e3586cef654eb037b36.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180599,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4cd54c95f0a4d4b9eff90e26b32d059.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201095,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7ff2d76caa6474191219f41a5063038.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176477,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dc7d7dccaa246deb9cb22c080a5249f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d/d1f1eec8-a3c8-5e8c-8239-bd3f0e4e4d2d_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159813,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e3dae1984ddd4964b015fda58bc38d04.jpg',
'Width': 1600}],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2015-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque 2.2 SD4 Dynamic 4WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2015}
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508185552424%27 HTTP/1.1" 200 None
2025-12-05 12:56:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508185552424: {'created_time': 1764939393.421593, 'last_price_update_time': 1764939393.421602}
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508185552424') HTTP/1.1" 204 0
2025-12-05 12:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:36 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent condition,top version,recently serviced,new timing '
'chain fitted, comes with 3 months warranty,12 months AA '
'breakdown cover,new mot, we accept all card payments',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 101,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138992',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'MINI',
'model': 'Hatch',
'odometer': 95000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1454631f533d436eb17da420e8a7641d.jpg',
'https://m.atcdn.co.uk/a/media/99365550aee847eab4f4ce5f71c8ceed.jpg',
'https://m.atcdn.co.uk/a/media/eb071a8b434a4333ac9a5d6ed86e102d.jpg',
'https://m.atcdn.co.uk/a/media/3eabda15fd7e4920be7f41326e38a287.jpg',
'https://m.atcdn.co.uk/a/media/7341ee4c9f1348caa2a1283432f79801.jpg',
'https://m.atcdn.co.uk/a/media/9a10cc72f66b4d8b9e75bb962ce9b5dc.jpg',
'https://m.atcdn.co.uk/a/media/e1dd723705db4641b768d870cc4e0f51.jpg',
'https://m.atcdn.co.uk/a/media/29cb26403e694633a0730bc7cbb2102f.jpg',
'https://m.atcdn.co.uk/a/media/91aef9d03dc24c2d9ca8f9fdedb9c9a6.jpg',
'https://m.atcdn.co.uk/a/media/5a1e2f7c987546c1bb8452e2b52c5120.jpg',
'https://m.atcdn.co.uk/a/media/de1a7124052a48a6b6f892e5d4668251.jpg',
'https://m.atcdn.co.uk/a/media/ec1b6ec5319b4473baedcb5bbe3b8d6e.jpg',
'https://m.atcdn.co.uk/a/media/def1874b1404414890b0638f8835c3f4.jpg'],
'price': 5299,
'price_includes_vat': True,
'registration_date': '2017-09-29',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Hatch 1.2 One Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'One',
'year': 2017}
2025-12-05 12:56:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ad4f7f-ec41-5ebc-b708-ffc1e9077cbd with identifier: 202511258138992
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 00ad4f7f-ec41-5ebc-b708-ffc1e9077cbd
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1454631f533d436eb17da420e8a7641d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1454631f533d436eb17da420e8a7641d.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F99365550aee847eab4f4ce5f71c8ceed.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/99365550aee847eab4f4ce5f71c8ceed.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb071a8b434a4333ac9a5d6ed86e102d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb071a8b434a4333ac9a5d6ed86e102d.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3eabda15fd7e4920be7f41326e38a287.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3eabda15fd7e4920be7f41326e38a287.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7341ee4c9f1348caa2a1283432f79801.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7341ee4c9f1348caa2a1283432f79801.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a10cc72f66b4d8b9e75bb962ce9b5dc.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a10cc72f66b4d8b9e75bb962ce9b5dc.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe1dd723705db4641b768d870cc4e0f51.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e1dd723705db4641b768d870cc4e0f51.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29cb26403e694633a0730bc7cbb2102f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29cb26403e694633a0730bc7cbb2102f.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91aef9d03dc24c2d9ca8f9fdedb9c9a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91aef9d03dc24c2d9ca8f9fdedb9c9a6.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a1e2f7c987546c1bb8452e2b52c5120.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a1e2f7c987546c1bb8452e2b52c5120.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde1a7124052a48a6b6f892e5d4668251.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de1a7124052a48a6b6f892e5d4668251.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec1b6ec5319b4473baedcb5bbe3b8d6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec1b6ec5319b4473baedcb5bbe3b8d6e.jpg already downloaded
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdef1874b1404414890b0638f8835c3f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/def1874b1404414890b0638f8835c3f4.jpg already downloaded
2025-12-05 12:56:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 00ad4f7f-ec41-5ebc-b708-ffc1e9077cbd with identifier 202511258138992
2025-12-05 12:56:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 00ad4f7f-ec41-5ebc-b708-ffc1e9077cbd
2025-12-05 12:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent condition,top version,recently serviced,new timing '
'chain fitted, comes with 3 months warranty,12 months AA '
'breakdown cover,new mot, we accept all card payments',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 101,
'fuel_type': 'Petrol',
'id': '00ad4f7f-ec41-5ebc-b708-ffc1e9077cbd',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138992',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'MINI',
'model': 'Hatch',
'odometer': 95000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1454631f533d436eb17da420e8a7641d.jpg',
'https://m.atcdn.co.uk/a/media/99365550aee847eab4f4ce5f71c8ceed.jpg',
'https://m.atcdn.co.uk/a/media/eb071a8b434a4333ac9a5d6ed86e102d.jpg',
'https://m.atcdn.co.uk/a/media/3eabda15fd7e4920be7f41326e38a287.jpg',
'https://m.atcdn.co.uk/a/media/7341ee4c9f1348caa2a1283432f79801.jpg',
'https://m.atcdn.co.uk/a/media/9a10cc72f66b4d8b9e75bb962ce9b5dc.jpg',
'https://m.atcdn.co.uk/a/media/e1dd723705db4641b768d870cc4e0f51.jpg',
'https://m.atcdn.co.uk/a/media/29cb26403e694633a0730bc7cbb2102f.jpg',
'https://m.atcdn.co.uk/a/media/91aef9d03dc24c2d9ca8f9fdedb9c9a6.jpg',
'https://m.atcdn.co.uk/a/media/5a1e2f7c987546c1bb8452e2b52c5120.jpg',
'https://m.atcdn.co.uk/a/media/de1a7124052a48a6b6f892e5d4668251.jpg',
'https://m.atcdn.co.uk/a/media/ec1b6ec5319b4473baedcb5bbe3b8d6e.jpg',
'https://m.atcdn.co.uk/a/media/def1874b1404414890b0638f8835c3f4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238662,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1454631f533d436eb17da420e8a7641d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287806,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/99365550aee847eab4f4ce5f71c8ceed.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234171,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb071a8b434a4333ac9a5d6ed86e102d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206083,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3eabda15fd7e4920be7f41326e38a287.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226695,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7341ee4c9f1348caa2a1283432f79801.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232945,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9a10cc72f66b4d8b9e75bb962ce9b5dc.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172458,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e1dd723705db4641b768d870cc4e0f51.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171021,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/29cb26403e694633a0730bc7cbb2102f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177593,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91aef9d03dc24c2d9ca8f9fdedb9c9a6.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156682,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a1e2f7c987546c1bb8452e2b52c5120.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133231,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/de1a7124052a48a6b6f892e5d4668251.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170606,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec1b6ec5319b4473baedcb5bbe3b8d6e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a87842-82c5-582e-92ca-b45db659aa4c/64a87842-82c5-582e-92ca-b45db659aa4c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182121,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/def1874b1404414890b0638f8835c3f4.jpg',
'Width': 1600}],
'price': 5299,
'price_includes_vat': True,
'registration_date': '2017-09-29',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Hatch 1.2 One Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'One',
'year': 2017}
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138992%27 HTTP/1.1" 200 None
2025-12-05 12:56:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258138992: {'created_time': 1764939396.535741, 'last_price_update_time': 1764939396.53575}
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258138992') HTTP/1.1" 204 0
2025-12-05 12:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:37 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history,2 keys,comes with 12 months AA breakdown cover,new '
'mot,3 months warranty,we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 91,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509116258535',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Peugeot',
'model': '308',
'odometer': 60700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/83e292c13e9549f5911e72d653ec557d.jpg',
'https://m.atcdn.co.uk/a/media/a171a153827e47198445afe55dc18f45.jpg',
'https://m.atcdn.co.uk/a/media/904358c7f9f7441aad3e4807de0a5fe6.jpg',
'https://m.atcdn.co.uk/a/media/27fe5b218ee146c49097f4b789be8374.jpg',
'https://m.atcdn.co.uk/a/media/db3b7443a1d34f46ac6814eadcc36bb7.jpg',
'https://m.atcdn.co.uk/a/media/8bb78d471c3d4c6c80cae9cdee671034.jpg',
'https://m.atcdn.co.uk/a/media/623feb1fff7d4461b0ddef27db8ff575.jpg',
'https://m.atcdn.co.uk/a/media/fe850c1a81e54a03adc93f8e65d643e9.jpg',
'https://m.atcdn.co.uk/a/media/2c0d6b44243743fbb04ea6f6ef7a5373.jpg',
'https://m.atcdn.co.uk/a/media/493832504f9a4d80817d390ebf2e54bf.jpg',
'https://m.atcdn.co.uk/a/media/3df24cb10e9448e6bacda0463c4bee45.jpg',
'https://m.atcdn.co.uk/a/media/8c22eea8d6ec47ff873857363c7f1334.jpg',
'https://m.atcdn.co.uk/a/media/c7dd2ea7b03a41b793365cc3ea17afd5.jpg'],
'price': 4799,
'price_includes_vat': True,
'registration_date': '2015-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Active Euro 5 5dr',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2025-12-05 12:56:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fc68c207-1197-5411-8e19-fed0cb5a7aa7 with identifier: 202509116258535
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item fc68c207-1197-5411-8e19-fed0cb5a7aa7
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83e292c13e9549f5911e72d653ec557d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83e292c13e9549f5911e72d653ec557d.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa171a153827e47198445afe55dc18f45.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a171a153827e47198445afe55dc18f45.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F904358c7f9f7441aad3e4807de0a5fe6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/904358c7f9f7441aad3e4807de0a5fe6.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27fe5b218ee146c49097f4b789be8374.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27fe5b218ee146c49097f4b789be8374.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb3b7443a1d34f46ac6814eadcc36bb7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db3b7443a1d34f46ac6814eadcc36bb7.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bb78d471c3d4c6c80cae9cdee671034.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bb78d471c3d4c6c80cae9cdee671034.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F623feb1fff7d4461b0ddef27db8ff575.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/623feb1fff7d4461b0ddef27db8ff575.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe850c1a81e54a03adc93f8e65d643e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe850c1a81e54a03adc93f8e65d643e9.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c0d6b44243743fbb04ea6f6ef7a5373.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c0d6b44243743fbb04ea6f6ef7a5373.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F493832504f9a4d80817d390ebf2e54bf.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/493832504f9a4d80817d390ebf2e54bf.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3df24cb10e9448e6bacda0463c4bee45.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3df24cb10e9448e6bacda0463c4bee45.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c22eea8d6ec47ff873857363c7f1334.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c22eea8d6ec47ff873857363c7f1334.jpg already downloaded
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7dd2ea7b03a41b793365cc3ea17afd5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7dd2ea7b03a41b793365cc3ea17afd5.jpg already downloaded
2025-12-05 12:56:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fc68c207-1197-5411-8e19-fed0cb5a7aa7 with identifier 202509116258535
2025-12-05 12:56:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fc68c207-1197-5411-8e19-fed0cb5a7aa7
2025-12-05 12:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history,2 keys,comes with 12 months AA breakdown cover,new '
'mot,3 months warranty,we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 91,
'fuel_type': 'Diesel',
'id': 'fc68c207-1197-5411-8e19-fed0cb5a7aa7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509116258535',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Peugeot',
'model': '308',
'odometer': 60700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/83e292c13e9549f5911e72d653ec557d.jpg',
'https://m.atcdn.co.uk/a/media/a171a153827e47198445afe55dc18f45.jpg',
'https://m.atcdn.co.uk/a/media/904358c7f9f7441aad3e4807de0a5fe6.jpg',
'https://m.atcdn.co.uk/a/media/27fe5b218ee146c49097f4b789be8374.jpg',
'https://m.atcdn.co.uk/a/media/db3b7443a1d34f46ac6814eadcc36bb7.jpg',
'https://m.atcdn.co.uk/a/media/8bb78d471c3d4c6c80cae9cdee671034.jpg',
'https://m.atcdn.co.uk/a/media/623feb1fff7d4461b0ddef27db8ff575.jpg',
'https://m.atcdn.co.uk/a/media/fe850c1a81e54a03adc93f8e65d643e9.jpg',
'https://m.atcdn.co.uk/a/media/2c0d6b44243743fbb04ea6f6ef7a5373.jpg',
'https://m.atcdn.co.uk/a/media/493832504f9a4d80817d390ebf2e54bf.jpg',
'https://m.atcdn.co.uk/a/media/3df24cb10e9448e6bacda0463c4bee45.jpg',
'https://m.atcdn.co.uk/a/media/8c22eea8d6ec47ff873857363c7f1334.jpg',
'https://m.atcdn.co.uk/a/media/c7dd2ea7b03a41b793365cc3ea17afd5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220875,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/83e292c13e9549f5911e72d653ec557d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305859,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a171a153827e47198445afe55dc18f45.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281411,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/904358c7f9f7441aad3e4807de0a5fe6.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284371,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/27fe5b218ee146c49097f4b789be8374.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261422,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db3b7443a1d34f46ac6814eadcc36bb7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167692,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8bb78d471c3d4c6c80cae9cdee671034.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125981,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/623feb1fff7d4461b0ddef27db8ff575.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266477,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe850c1a81e54a03adc93f8e65d643e9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149341,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c0d6b44243743fbb04ea6f6ef7a5373.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161867,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/493832504f9a4d80817d390ebf2e54bf.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186143,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3df24cb10e9448e6bacda0463c4bee45.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132668,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c22eea8d6ec47ff873857363c7f1334.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bc97d6-fae2-5fec-bc25-270e44f26894/b5bc97d6-fae2-5fec-bc25-270e44f26894_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158131,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7dd2ea7b03a41b793365cc3ea17afd5.jpg',
'Width': 1600}],
'price': 4799,
'price_includes_vat': True,
'registration_date': '2015-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Active Euro 5 5dr',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116258535%27 HTTP/1.1" 200 None
2025-12-05 12:56:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509116258535: {'created_time': 1764939397.710998, 'last_price_update_time': 1764939397.71101}
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509116258535') HTTP/1.1" 204 0
2025-12-05 12:56:37 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 15 pages/min), scraped 13 items (at 13 items/min)
2025-12-05 12:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:38 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 160,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent condition,top version,automatic, 2 keys, just '
'serviced, service history, comes with 3 months warranty,12 '
'months AA breakdown cover,new mot,we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509166384985',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 41000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ac122f4d1fc14572a895c1959377b157.jpg',
'https://m.atcdn.co.uk/a/media/76875531211741979135324ae6359e13.jpg',
'https://m.atcdn.co.uk/a/media/336f579b901242e5a2f35bef5a1dd284.jpg',
'https://m.atcdn.co.uk/a/media/e0cf8a33bdeb4d7f9ac0448d052109e5.jpg',
'https://m.atcdn.co.uk/a/media/4a6e6819a9684c11ab5b4c056f2611c5.jpg',
'https://m.atcdn.co.uk/a/media/92acc1537c374b1e8b05fe2f2af9d2ed.jpg',
'https://m.atcdn.co.uk/a/media/51138cebd0014678b6d95000eb923c41.jpg',
'https://m.atcdn.co.uk/a/media/1a94cf8494cc45c5ad1335e9ff965573.jpg',
'https://m.atcdn.co.uk/a/media/33fd7558c7e447ae8ba0b82ee019019f.jpg',
'https://m.atcdn.co.uk/a/media/eae3a2768c8649d0afda1182336c3216.jpg',
'https://m.atcdn.co.uk/a/media/e8302164792945988cec8c59da70b05c.jpg',
'https://m.atcdn.co.uk/a/media/939215faedc444f3a926b1181152c0a7.jpg',
'https://m.atcdn.co.uk/a/media/0fb107729a4d49929b3a5f63091c38f6.jpg'],
'price': 8499,
'price_includes_vat': True,
'registration_date': '2015-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Mokka 1.4i Turbo Exclusiv Auto 2WD Euro 6 5dr',
'transmission': 'automatic',
'trim': 'Exclusiv',
'year': 2015}
2025-12-05 12:56:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b32ff23b-43eb-54aa-81c4-59961ce6f70d with identifier: 202509166384985
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item b32ff23b-43eb-54aa-81c4-59961ce6f70d
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac122f4d1fc14572a895c1959377b157.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac122f4d1fc14572a895c1959377b157.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76875531211741979135324ae6359e13.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76875531211741979135324ae6359e13.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F336f579b901242e5a2f35bef5a1dd284.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/336f579b901242e5a2f35bef5a1dd284.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0cf8a33bdeb4d7f9ac0448d052109e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0cf8a33bdeb4d7f9ac0448d052109e5.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a6e6819a9684c11ab5b4c056f2611c5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a6e6819a9684c11ab5b4c056f2611c5.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92acc1537c374b1e8b05fe2f2af9d2ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92acc1537c374b1e8b05fe2f2af9d2ed.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51138cebd0014678b6d95000eb923c41.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51138cebd0014678b6d95000eb923c41.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a94cf8494cc45c5ad1335e9ff965573.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a94cf8494cc45c5ad1335e9ff965573.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33fd7558c7e447ae8ba0b82ee019019f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33fd7558c7e447ae8ba0b82ee019019f.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feae3a2768c8649d0afda1182336c3216.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eae3a2768c8649d0afda1182336c3216.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe8302164792945988cec8c59da70b05c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e8302164792945988cec8c59da70b05c.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F939215faedc444f3a926b1181152c0a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/939215faedc444f3a926b1181152c0a7.jpg already downloaded
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0fb107729a4d49929b3a5f63091c38f6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0fb107729a4d49929b3a5f63091c38f6.jpg already downloaded
2025-12-05 12:56:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b32ff23b-43eb-54aa-81c4-59961ce6f70d with identifier 202509166384985
2025-12-05 12:56:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b32ff23b-43eb-54aa-81c4-59961ce6f70d
2025-12-05 12:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 160,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent condition,top version,automatic, 2 keys, just '
'serviced, service history, comes with 3 months warranty,12 '
'months AA breakdown cover,new mot,we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': 'b32ff23b-43eb-54aa-81c4-59961ce6f70d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509166384985',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 41000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ac122f4d1fc14572a895c1959377b157.jpg',
'https://m.atcdn.co.uk/a/media/76875531211741979135324ae6359e13.jpg',
'https://m.atcdn.co.uk/a/media/336f579b901242e5a2f35bef5a1dd284.jpg',
'https://m.atcdn.co.uk/a/media/e0cf8a33bdeb4d7f9ac0448d052109e5.jpg',
'https://m.atcdn.co.uk/a/media/4a6e6819a9684c11ab5b4c056f2611c5.jpg',
'https://m.atcdn.co.uk/a/media/92acc1537c374b1e8b05fe2f2af9d2ed.jpg',
'https://m.atcdn.co.uk/a/media/51138cebd0014678b6d95000eb923c41.jpg',
'https://m.atcdn.co.uk/a/media/1a94cf8494cc45c5ad1335e9ff965573.jpg',
'https://m.atcdn.co.uk/a/media/33fd7558c7e447ae8ba0b82ee019019f.jpg',
'https://m.atcdn.co.uk/a/media/eae3a2768c8649d0afda1182336c3216.jpg',
'https://m.atcdn.co.uk/a/media/e8302164792945988cec8c59da70b05c.jpg',
'https://m.atcdn.co.uk/a/media/939215faedc444f3a926b1181152c0a7.jpg',
'https://m.atcdn.co.uk/a/media/0fb107729a4d49929b3a5f63091c38f6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262642,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac122f4d1fc14572a895c1959377b157.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223339,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/76875531211741979135324ae6359e13.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274052,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/336f579b901242e5a2f35bef5a1dd284.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256430,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0cf8a33bdeb4d7f9ac0448d052109e5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260964,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a6e6819a9684c11ab5b4c056f2611c5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237292,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92acc1537c374b1e8b05fe2f2af9d2ed.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198268,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51138cebd0014678b6d95000eb923c41.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201933,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a94cf8494cc45c5ad1335e9ff965573.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202128,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/33fd7558c7e447ae8ba0b82ee019019f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140350,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eae3a2768c8649d0afda1182336c3216.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153408,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e8302164792945988cec8c59da70b05c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245224,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/939215faedc444f3a926b1181152c0a7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af154728-f653-539b-8b45-63be25d11e36/af154728-f653-539b-8b45-63be25d11e36_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226084,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0fb107729a4d49929b3a5f63091c38f6.jpg',
'Width': 1600}],
'price': 8499,
'price_includes_vat': True,
'registration_date': '2015-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Mokka 1.4i Turbo Exclusiv Auto 2WD Euro 6 5dr',
'transmission': 'automatic',
'trim': 'Exclusiv',
'year': 2015}
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509166384985%27 HTTP/1.1" 200 None
2025-12-05 12:56:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509166384985: {'created_time': 1764939398.685108, 'last_price_update_time': 1764939398.685118}
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509166384985') HTTP/1.1" 204 0
2025-12-05 12:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:39 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Silver',
'currency': 'GBP',
'description': 'Automatic car,excellent condition,top version,recently '
'serviced,service history ,comes with 3 months warranty,12 '
'months AA breakdown cover,new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 94,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306772274',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 40285,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/cd2a60148db149f2accdb2a3458d279c.jpg',
'https://m.atcdn.co.uk/a/media/16a462a256fc4f75b631728bf1d345e5.jpg',
'https://m.atcdn.co.uk/a/media/097438d911c54a0fb9f91fbc7c714df4.jpg',
'https://m.atcdn.co.uk/a/media/60bcb19a25454965bf238048746d1959.jpg',
'https://m.atcdn.co.uk/a/media/d449c4eca71142a4ba6241b992c7e9cf.jpg',
'https://m.atcdn.co.uk/a/media/3258cbfc701e4ec09f1454703f83bb72.jpg'],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2010-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Titanium 5dr',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2010}
2025-12-05 12:56:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 167560e3-31af-50da-b282-253f659460bf with identifier: 202509306772274
2025-12-05 12:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 167560e3-31af-50da-b282-253f659460bf
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd2a60148db149f2accdb2a3458d279c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd2a60148db149f2accdb2a3458d279c.jpg already downloaded
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16a462a256fc4f75b631728bf1d345e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16a462a256fc4f75b631728bf1d345e5.jpg already downloaded
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F097438d911c54a0fb9f91fbc7c714df4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/097438d911c54a0fb9f91fbc7c714df4.jpg already downloaded
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60bcb19a25454965bf238048746d1959.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60bcb19a25454965bf238048746d1959.jpg already downloaded
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd449c4eca71142a4ba6241b992c7e9cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d449c4eca71142a4ba6241b992c7e9cf.jpg already downloaded
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3258cbfc701e4ec09f1454703f83bb72.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3258cbfc701e4ec09f1454703f83bb72.jpg already downloaded
2025-12-05 12:56:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 167560e3-31af-50da-b282-253f659460bf with identifier 202509306772274
2025-12-05 12:56:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 167560e3-31af-50da-b282-253f659460bf
2025-12-05 12:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Silver',
'currency': 'GBP',
'description': 'Automatic car,excellent condition,top version,recently '
'serviced,service history ,comes with 3 months warranty,12 '
'months AA breakdown cover,new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 94,
'fuel_type': 'Petrol',
'id': '167560e3-31af-50da-b282-253f659460bf',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306772274',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 40285,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 6,
'photo_urls': ['https://m.atcdn.co.uk/a/media/cd2a60148db149f2accdb2a3458d279c.jpg',
'https://m.atcdn.co.uk/a/media/16a462a256fc4f75b631728bf1d345e5.jpg',
'https://m.atcdn.co.uk/a/media/097438d911c54a0fb9f91fbc7c714df4.jpg',
'https://m.atcdn.co.uk/a/media/60bcb19a25454965bf238048746d1959.jpg',
'https://m.atcdn.co.uk/a/media/d449c4eca71142a4ba6241b992c7e9cf.jpg',
'https://m.atcdn.co.uk/a/media/3258cbfc701e4ec09f1454703f83bb72.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e93993-87fa-5da1-aa8b-27c033356e06/01e93993-87fa-5da1-aa8b-27c033356e06_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258562,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd2a60148db149f2accdb2a3458d279c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e93993-87fa-5da1-aa8b-27c033356e06/01e93993-87fa-5da1-aa8b-27c033356e06_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256319,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/16a462a256fc4f75b631728bf1d345e5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e93993-87fa-5da1-aa8b-27c033356e06/01e93993-87fa-5da1-aa8b-27c033356e06_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220817,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/097438d911c54a0fb9f91fbc7c714df4.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e93993-87fa-5da1-aa8b-27c033356e06/01e93993-87fa-5da1-aa8b-27c033356e06_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268251,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60bcb19a25454965bf238048746d1959.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e93993-87fa-5da1-aa8b-27c033356e06/01e93993-87fa-5da1-aa8b-27c033356e06_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262497,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d449c4eca71142a4ba6241b992c7e9cf.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e93993-87fa-5da1-aa8b-27c033356e06/01e93993-87fa-5da1-aa8b-27c033356e06_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212961,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3258cbfc701e4ec09f1454703f83bb72.jpg',
'Width': 1600}],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2010-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Titanium 5dr',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2010}
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306772274%27 HTTP/1.1" 200 None
2025-12-05 12:56:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509306772274: {'created_time': 1764939399.527225, 'last_price_update_time': 1764939399.527235}
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509306772274') HTTP/1.1" 204 0
2025-12-05 12:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:45 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 95,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent runner,2 keys, new mot, full service history, low '
'tax and insurance group, comes with 3 months warranty,12 '
'months AA breakdown cover, new mot,we accept all card '
'payments',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 67,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506193683545',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'AYGO',
'odometer': 46000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/df85d0fd1fc3434c868ff29f9691fd07.jpg',
'https://m.atcdn.co.uk/a/media/faee01dbb22e42828a0223690a0bbcf1.jpg',
'https://m.atcdn.co.uk/a/media/971ad6923fe14af6a6ffc9c844cdd875.jpg',
'https://m.atcdn.co.uk/a/media/968abfe709c147cb9b441554cde2e1bc.jpg',
'https://m.atcdn.co.uk/a/media/9659b365474445b2bd50d3f635d864e5.jpg',
'https://m.atcdn.co.uk/a/media/994565f718d24efc8665af0110aac11b.jpg',
'https://m.atcdn.co.uk/a/media/868042cf761d455cb9923a6c12eae6ca.jpg',
'https://m.atcdn.co.uk/a/media/3afbdd1e73d54dc6aa3152db9439794f.jpg',
'https://m.atcdn.co.uk/a/media/1289a2a0638b4e69baa32a05e4b6434e.jpg',
'https://m.atcdn.co.uk/a/media/252cfdf8bdc14a99ac2bb846796bf13a.jpg',
'https://m.atcdn.co.uk/a/media/94dcc69ca9184b5fad7bd44a68b2782e.jpg',
'https://m.atcdn.co.uk/a/media/57a383be7008453c9eb00cc7b3f37331.jpg',
'https://m.atcdn.co.uk/a/media/49e6aca8f54f4cc7a35ff2aa185500d3.jpg'],
'price': 4999,
'price_includes_vat': True,
'registration_date': '2017-02-23',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo 1.0 VVT-i x-play Euro 6 5dr',
'transmission': 'manual',
'trim': 'x-play',
'year': 2017}
2025-12-05 12:56:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dde33ca8-fd97-5e8c-95b9-c32512e5965d with identifier: 202506193683545
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item dde33ca8-fd97-5e8c-95b9-c32512e5965d
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf85d0fd1fc3434c868ff29f9691fd07.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df85d0fd1fc3434c868ff29f9691fd07.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffaee01dbb22e42828a0223690a0bbcf1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/faee01dbb22e42828a0223690a0bbcf1.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F971ad6923fe14af6a6ffc9c844cdd875.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/971ad6923fe14af6a6ffc9c844cdd875.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F968abfe709c147cb9b441554cde2e1bc.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/968abfe709c147cb9b441554cde2e1bc.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9659b365474445b2bd50d3f635d864e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9659b365474445b2bd50d3f635d864e5.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F994565f718d24efc8665af0110aac11b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/994565f718d24efc8665af0110aac11b.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F868042cf761d455cb9923a6c12eae6ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/868042cf761d455cb9923a6c12eae6ca.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3afbdd1e73d54dc6aa3152db9439794f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3afbdd1e73d54dc6aa3152db9439794f.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1289a2a0638b4e69baa32a05e4b6434e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1289a2a0638b4e69baa32a05e4b6434e.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F252cfdf8bdc14a99ac2bb846796bf13a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/252cfdf8bdc14a99ac2bb846796bf13a.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F94dcc69ca9184b5fad7bd44a68b2782e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/94dcc69ca9184b5fad7bd44a68b2782e.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F57a383be7008453c9eb00cc7b3f37331.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/57a383be7008453c9eb00cc7b3f37331.jpg already downloaded
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49e6aca8f54f4cc7a35ff2aa185500d3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49e6aca8f54f4cc7a35ff2aa185500d3.jpg already downloaded
2025-12-05 12:56:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dde33ca8-fd97-5e8c-95b9-c32512e5965d with identifier 202506193683545
2025-12-05 12:56:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dde33ca8-fd97-5e8c-95b9-c32512e5965d
2025-12-05 12:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 95,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent runner,2 keys, new mot, full service history, low '
'tax and insurance group, comes with 3 months warranty,12 '
'months AA breakdown cover, new mot,we accept all card '
'payments',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 67,
'fuel_type': 'Petrol',
'id': 'dde33ca8-fd97-5e8c-95b9-c32512e5965d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506193683545',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'AYGO',
'odometer': 46000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/df85d0fd1fc3434c868ff29f9691fd07.jpg',
'https://m.atcdn.co.uk/a/media/faee01dbb22e42828a0223690a0bbcf1.jpg',
'https://m.atcdn.co.uk/a/media/971ad6923fe14af6a6ffc9c844cdd875.jpg',
'https://m.atcdn.co.uk/a/media/968abfe709c147cb9b441554cde2e1bc.jpg',
'https://m.atcdn.co.uk/a/media/9659b365474445b2bd50d3f635d864e5.jpg',
'https://m.atcdn.co.uk/a/media/994565f718d24efc8665af0110aac11b.jpg',
'https://m.atcdn.co.uk/a/media/868042cf761d455cb9923a6c12eae6ca.jpg',
'https://m.atcdn.co.uk/a/media/3afbdd1e73d54dc6aa3152db9439794f.jpg',
'https://m.atcdn.co.uk/a/media/1289a2a0638b4e69baa32a05e4b6434e.jpg',
'https://m.atcdn.co.uk/a/media/252cfdf8bdc14a99ac2bb846796bf13a.jpg',
'https://m.atcdn.co.uk/a/media/94dcc69ca9184b5fad7bd44a68b2782e.jpg',
'https://m.atcdn.co.uk/a/media/57a383be7008453c9eb00cc7b3f37331.jpg',
'https://m.atcdn.co.uk/a/media/49e6aca8f54f4cc7a35ff2aa185500d3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224804,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/df85d0fd1fc3434c868ff29f9691fd07.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199231,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/faee01dbb22e42828a0223690a0bbcf1.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275199,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/971ad6923fe14af6a6ffc9c844cdd875.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283571,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/968abfe709c147cb9b441554cde2e1bc.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238987,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9659b365474445b2bd50d3f635d864e5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251681,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/994565f718d24efc8665af0110aac11b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168544,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/868042cf761d455cb9923a6c12eae6ca.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135197,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3afbdd1e73d54dc6aa3152db9439794f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114485,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1289a2a0638b4e69baa32a05e4b6434e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82258,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/252cfdf8bdc14a99ac2bb846796bf13a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194017,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/94dcc69ca9184b5fad7bd44a68b2782e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118153,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/57a383be7008453c9eb00cc7b3f37331.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd2e55b-80cc-57f0-8cdf-e956ba770199/9dd2e55b-80cc-57f0-8cdf-e956ba770199_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111892,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/49e6aca8f54f4cc7a35ff2aa185500d3.jpg',
'Width': 1600}],
'price': 4999,
'price_includes_vat': True,
'registration_date': '2017-02-23',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo 1.0 VVT-i x-play Euro 6 5dr',
'transmission': 'manual',
'trim': 'x-play',
'year': 2017}
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506193683545%27 HTTP/1.1" 200 None
2025-12-05 12:56:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506193683545: {'created_time': 1764939405.551253, 'last_price_update_time': 1764939405.551265}
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506193683545') HTTP/1.1" 204 0
2025-12-05 12:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:46 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'Silver',
'currency': 'GBP',
'description': 'Excellent condition, spacious car, recently serviced,service '
'history, comes with 3 months warranty,12 months AA breakdown '
'cover,new mot',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 108,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510097033704',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 39849,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/88ace7edce9b4c4ab2174bd98d7acca4.jpg',
'https://m.atcdn.co.uk/a/media/22e9b3f66d44496185e8efe8a743dfcb.jpg',
'https://m.atcdn.co.uk/a/media/95eef7623ed74ac786a1d8a4d8ad6eed.jpg',
'https://m.atcdn.co.uk/a/media/5c2179c08b51419fa5bb9e7c1612394a.jpg',
'https://m.atcdn.co.uk/a/media/1bb5983a714e44669a521a9907557f21.jpg',
'https://m.atcdn.co.uk/a/media/091688ee0d6a434988954a52c1b13b78.jpg',
'https://m.atcdn.co.uk/a/media/e91d233a65584d1199568e35d7adad09.jpg',
'https://m.atcdn.co.uk/a/media/5bf6ed6a7c864ced8800daa5b39e3f92.jpg',
'https://m.atcdn.co.uk/a/media/4a02abead6ca4c1cbe03c4ad03f8ac10.jpg',
'https://m.atcdn.co.uk/a/media/a0b9851d1d474c9993cb9a5be09e20fb.jpg',
'https://m.atcdn.co.uk/a/media/4c1e605cfbaf48db940d7d4879e1d4e9.jpg',
'https://m.atcdn.co.uk/a/media/b533ace508aa4a648b2fc3784c36c9b5.jpg',
'https://m.atcdn.co.uk/a/media/0f0e5209cdf64b8db6326ed07d0170b9.jpg'],
'price': 5699,
'price_includes_vat': True,
'registration_date': '2016-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Picasso 1.2 PureTech Platinum Euro 6 5dr',
'transmission': 'manual',
'trim': 'Platinum',
'year': 2016}
2025-12-05 12:56:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b151df42-75c0-548e-964d-40c2d03eb74e with identifier: 202510097033704
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item b151df42-75c0-548e-964d-40c2d03eb74e
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F88ace7edce9b4c4ab2174bd98d7acca4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/88ace7edce9b4c4ab2174bd98d7acca4.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F22e9b3f66d44496185e8efe8a743dfcb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/22e9b3f66d44496185e8efe8a743dfcb.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F95eef7623ed74ac786a1d8a4d8ad6eed.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/95eef7623ed74ac786a1d8a4d8ad6eed.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c2179c08b51419fa5bb9e7c1612394a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c2179c08b51419fa5bb9e7c1612394a.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1bb5983a714e44669a521a9907557f21.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1bb5983a714e44669a521a9907557f21.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F091688ee0d6a434988954a52c1b13b78.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/091688ee0d6a434988954a52c1b13b78.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe91d233a65584d1199568e35d7adad09.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e91d233a65584d1199568e35d7adad09.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5bf6ed6a7c864ced8800daa5b39e3f92.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5bf6ed6a7c864ced8800daa5b39e3f92.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a02abead6ca4c1cbe03c4ad03f8ac10.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a02abead6ca4c1cbe03c4ad03f8ac10.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0b9851d1d474c9993cb9a5be09e20fb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0b9851d1d474c9993cb9a5be09e20fb.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c1e605cfbaf48db940d7d4879e1d4e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c1e605cfbaf48db940d7d4879e1d4e9.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb533ace508aa4a648b2fc3784c36c9b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b533ace508aa4a648b2fc3784c36c9b5.jpg already downloaded
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f0e5209cdf64b8db6326ed07d0170b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f0e5209cdf64b8db6326ed07d0170b9.jpg already downloaded
2025-12-05 12:56:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b151df42-75c0-548e-964d-40c2d03eb74e with identifier 202510097033704
2025-12-05 12:56:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b151df42-75c0-548e-964d-40c2d03eb74e
2025-12-05 12:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'Silver',
'currency': 'GBP',
'description': 'Excellent condition, spacious car, recently serviced,service '
'history, comes with 3 months warranty,12 months AA breakdown '
'cover,new mot',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 108,
'fuel_type': 'Petrol',
'id': 'b151df42-75c0-548e-964d-40c2d03eb74e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510097033704',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 39849,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/88ace7edce9b4c4ab2174bd98d7acca4.jpg',
'https://m.atcdn.co.uk/a/media/22e9b3f66d44496185e8efe8a743dfcb.jpg',
'https://m.atcdn.co.uk/a/media/95eef7623ed74ac786a1d8a4d8ad6eed.jpg',
'https://m.atcdn.co.uk/a/media/5c2179c08b51419fa5bb9e7c1612394a.jpg',
'https://m.atcdn.co.uk/a/media/1bb5983a714e44669a521a9907557f21.jpg',
'https://m.atcdn.co.uk/a/media/091688ee0d6a434988954a52c1b13b78.jpg',
'https://m.atcdn.co.uk/a/media/e91d233a65584d1199568e35d7adad09.jpg',
'https://m.atcdn.co.uk/a/media/5bf6ed6a7c864ced8800daa5b39e3f92.jpg',
'https://m.atcdn.co.uk/a/media/4a02abead6ca4c1cbe03c4ad03f8ac10.jpg',
'https://m.atcdn.co.uk/a/media/a0b9851d1d474c9993cb9a5be09e20fb.jpg',
'https://m.atcdn.co.uk/a/media/4c1e605cfbaf48db940d7d4879e1d4e9.jpg',
'https://m.atcdn.co.uk/a/media/b533ace508aa4a648b2fc3784c36c9b5.jpg',
'https://m.atcdn.co.uk/a/media/0f0e5209cdf64b8db6326ed07d0170b9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223852,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/88ace7edce9b4c4ab2174bd98d7acca4.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224344,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/22e9b3f66d44496185e8efe8a743dfcb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211013,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/95eef7623ed74ac786a1d8a4d8ad6eed.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a99e8de7-6739-5c43-93ab-37442f850fdc/a99e8de7-6739-5c43-93ab-37442f850fdc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179899,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0b9851d1d474c9993cb9a5be09e20fb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227578,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c2179c08b51419fa5bb9e7c1612394a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221676,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1bb5983a714e44669a521a9907557f21.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209504,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/091688ee0d6a434988954a52c1b13b78.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172621,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e91d233a65584d1199568e35d7adad09.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149339,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5bf6ed6a7c864ced8800daa5b39e3f92.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172378,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a02abead6ca4c1cbe03c4ad03f8ac10.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105955,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4c1e605cfbaf48db940d7d4879e1d4e9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172238,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b533ace508aa4a648b2fc3784c36c9b5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36ca61bd-730b-5bd7-8b39-762395b85c2d/36ca61bd-730b-5bd7-8b39-762395b85c2d_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199786,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f0e5209cdf64b8db6326ed07d0170b9.jpg',
'Width': 1600}],
'price': 5699,
'price_includes_vat': True,
'registration_date': '2016-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Picasso 1.2 PureTech Platinum Euro 6 5dr',
'transmission': 'manual',
'trim': 'Platinum',
'year': 2016}
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510097033704%27 HTTP/1.1" 200 None
2025-12-05 12:56:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510097033704: {'created_time': 1764939406.716207, 'last_price_update_time': 1764939406.716215}
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510097033704') HTTP/1.1" 204 0
2025-12-05 12:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:54 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent condition, genuine low mileage, service history, '
'recently serviced, comes with 3 months warranty,12 months AA '
'breakdown cover, new mot, low tax and insurance group',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1L',
'engine_horse_power': 67,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510107065504',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Citroen',
'model': 'C1',
'odometer': 30134,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/89fdc8db6e574e2fa89afac492ecd016.jpg',
'https://m.atcdn.co.uk/a/media/c81dab9563d248799b3e17711df648b3.jpg',
'https://m.atcdn.co.uk/a/media/e2a9a8705ddd43cdbd8402f8885aaa83.jpg',
'https://m.atcdn.co.uk/a/media/8a84b880d3d541479f3c614619d1ace0.jpg',
'https://m.atcdn.co.uk/a/media/c9c5ae3700cb482ea6ba93dc7089ee25.jpg',
'https://m.atcdn.co.uk/a/media/aa4c969468a44c138bd97ae150931264.jpg',
'https://m.atcdn.co.uk/a/media/136931f7b7e7452ca59cfeda4aff735e.jpg',
'https://m.atcdn.co.uk/a/media/8e9a49ba15f8408787854f3ef122eb27.jpg',
'https://m.atcdn.co.uk/a/media/4ed8f68b30754d259616e44f857f6db5.jpg',
'https://m.atcdn.co.uk/a/media/bc68c05304a148009539f5a589abf61c.jpg',
'https://m.atcdn.co.uk/a/media/beabeea3556d49009ef412177e113e6a.jpg',
'https://m.atcdn.co.uk/a/media/9bb55ba227cf47f594b61a66b6f9f706.jpg'],
'price': 3999,
'price_includes_vat': True,
'registration_date': '2014-04-30',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0i Edition Euro 5 3dr',
'transmission': 'manual',
'trim': 'Edition',
'year': 2014}
2025-12-05 12:56:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ee95d4e8-a3a2-59ce-a1ef-a5557091fdbc with identifier: 202510107065504
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item ee95d4e8-a3a2-59ce-a1ef-a5557091fdbc
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89fdc8db6e574e2fa89afac492ecd016.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89fdc8db6e574e2fa89afac492ecd016.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc81dab9563d248799b3e17711df648b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c81dab9563d248799b3e17711df648b3.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe2a9a8705ddd43cdbd8402f8885aaa83.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e2a9a8705ddd43cdbd8402f8885aaa83.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a84b880d3d541479f3c614619d1ace0.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a84b880d3d541479f3c614619d1ace0.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9c5ae3700cb482ea6ba93dc7089ee25.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9c5ae3700cb482ea6ba93dc7089ee25.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa4c969468a44c138bd97ae150931264.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa4c969468a44c138bd97ae150931264.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F136931f7b7e7452ca59cfeda4aff735e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/136931f7b7e7452ca59cfeda4aff735e.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e9a49ba15f8408787854f3ef122eb27.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e9a49ba15f8408787854f3ef122eb27.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ed8f68b30754d259616e44f857f6db5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ed8f68b30754d259616e44f857f6db5.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc68c05304a148009539f5a589abf61c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc68c05304a148009539f5a589abf61c.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbeabeea3556d49009ef412177e113e6a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/beabeea3556d49009ef412177e113e6a.jpg already downloaded
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9bb55ba227cf47f594b61a66b6f9f706.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9bb55ba227cf47f594b61a66b6f9f706.jpg already downloaded
2025-12-05 12:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ee95d4e8-a3a2-59ce-a1ef-a5557091fdbc with identifier 202510107065504
2025-12-05 12:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ee95d4e8-a3a2-59ce-a1ef-a5557091fdbc
2025-12-05 12:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent condition, genuine low mileage, service history, '
'recently serviced, comes with 3 months warranty,12 months AA '
'breakdown cover, new mot, low tax and insurance group',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1L',
'engine_horse_power': 67,
'fuel_type': 'Petrol',
'id': 'ee95d4e8-a3a2-59ce-a1ef-a5557091fdbc',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510107065504',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Citroen',
'model': 'C1',
'odometer': 30134,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/89fdc8db6e574e2fa89afac492ecd016.jpg',
'https://m.atcdn.co.uk/a/media/c81dab9563d248799b3e17711df648b3.jpg',
'https://m.atcdn.co.uk/a/media/e2a9a8705ddd43cdbd8402f8885aaa83.jpg',
'https://m.atcdn.co.uk/a/media/8a84b880d3d541479f3c614619d1ace0.jpg',
'https://m.atcdn.co.uk/a/media/c9c5ae3700cb482ea6ba93dc7089ee25.jpg',
'https://m.atcdn.co.uk/a/media/aa4c969468a44c138bd97ae150931264.jpg',
'https://m.atcdn.co.uk/a/media/136931f7b7e7452ca59cfeda4aff735e.jpg',
'https://m.atcdn.co.uk/a/media/8e9a49ba15f8408787854f3ef122eb27.jpg',
'https://m.atcdn.co.uk/a/media/4ed8f68b30754d259616e44f857f6db5.jpg',
'https://m.atcdn.co.uk/a/media/bc68c05304a148009539f5a589abf61c.jpg',
'https://m.atcdn.co.uk/a/media/beabeea3556d49009ef412177e113e6a.jpg',
'https://m.atcdn.co.uk/a/media/9bb55ba227cf47f594b61a66b6f9f706.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253706,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/89fdc8db6e574e2fa89afac492ecd016.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240488,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c81dab9563d248799b3e17711df648b3.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226700,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e2a9a8705ddd43cdbd8402f8885aaa83.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273640,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8a84b880d3d541479f3c614619d1ace0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225730,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9c5ae3700cb482ea6ba93dc7089ee25.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284199,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa4c969468a44c138bd97ae150931264.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128456,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/136931f7b7e7452ca59cfeda4aff735e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115199,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8e9a49ba15f8408787854f3ef122eb27.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112062,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ed8f68b30754d259616e44f857f6db5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147461,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc68c05304a148009539f5a589abf61c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153566,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/beabeea3556d49009ef412177e113e6a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_842e7a4f-db05-5382-9391-75952a60bfe0/842e7a4f-db05-5382-9391-75952a60bfe0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122652,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9bb55ba227cf47f594b61a66b6f9f706.jpg',
'Width': 1600}],
'price': 3999,
'price_includes_vat': True,
'registration_date': '2014-04-30',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0i Edition Euro 5 3dr',
'transmission': 'manual',
'trim': 'Edition',
'year': 2014}
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510107065504%27 HTTP/1.1" 200 None
2025-12-05 12:56:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510107065504: {'created_time': 1764939414.699711, 'last_price_update_time': 1764939414.69972}
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510107065504') HTTP/1.1" 204 0
2025-12-05 12:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:56:58 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent condition, recently serviced,service '
'history,amazing mileage per gallon, comes with 3 months '
'warranty,12 months AA breakdown cover,new mot,we accept all '
'card payments,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510147152053',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 102000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/467cde015d984b78af983a4a199cdc09.jpg',
'https://m.atcdn.co.uk/a/media/e379dd13c99443ccbd647c752407156a.jpg',
'https://m.atcdn.co.uk/a/media/c2aefb021b7445ff8ec2835e0cbc0ba8.jpg',
'https://m.atcdn.co.uk/a/media/3e25636c55ee4679b43633600a596b81.jpg',
'https://m.atcdn.co.uk/a/media/90d79892c61945459dd0ba80886b9e8b.jpg',
'https://m.atcdn.co.uk/a/media/9bd4098f710d45a28c8280bb6d2c0062.jpg',
'https://m.atcdn.co.uk/a/media/8a97a139f2ef4bce9893c5a5e70f7866.jpg',
'https://m.atcdn.co.uk/a/media/6151094e24ec4939a7b7e347db25c6eb.jpg',
'https://m.atcdn.co.uk/a/media/047fe97b9db4438b936bf001c06e74f7.jpg',
'https://m.atcdn.co.uk/a/media/0ef342926f5144978cc03a52332d5e4f.jpg',
'https://m.atcdn.co.uk/a/media/cf2fa7b3fe3c4f87b64c59eaf71a6347.jpg',
'https://m.atcdn.co.uk/a/media/968090d186cd41d7aa57c9eb11780678.jpg',
'https://m.atcdn.co.uk/a/media/b5669987b57b47a6a0786fcd91f55889.jpg'],
'price': 7777,
'price_includes_vat': True,
'registration_date': '2019-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Octavia 1.5 TSI ACT SE L DSG Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE L',
'year': 2019}
2025-12-05 12:56:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f252176-08f4-582b-b7c4-19831c1e9111 with identifier: 202510147152053
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0f252176-08f4-582b-b7c4-19831c1e9111
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F467cde015d984b78af983a4a199cdc09.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/467cde015d984b78af983a4a199cdc09.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe379dd13c99443ccbd647c752407156a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e379dd13c99443ccbd647c752407156a.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc2aefb021b7445ff8ec2835e0cbc0ba8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c2aefb021b7445ff8ec2835e0cbc0ba8.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e25636c55ee4679b43633600a596b81.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e25636c55ee4679b43633600a596b81.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90d79892c61945459dd0ba80886b9e8b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90d79892c61945459dd0ba80886b9e8b.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9bd4098f710d45a28c8280bb6d2c0062.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9bd4098f710d45a28c8280bb6d2c0062.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a97a139f2ef4bce9893c5a5e70f7866.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a97a139f2ef4bce9893c5a5e70f7866.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6151094e24ec4939a7b7e347db25c6eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6151094e24ec4939a7b7e347db25c6eb.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F047fe97b9db4438b936bf001c06e74f7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/047fe97b9db4438b936bf001c06e74f7.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ef342926f5144978cc03a52332d5e4f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ef342926f5144978cc03a52332d5e4f.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf2fa7b3fe3c4f87b64c59eaf71a6347.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf2fa7b3fe3c4f87b64c59eaf71a6347.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F968090d186cd41d7aa57c9eb11780678.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/968090d186cd41d7aa57c9eb11780678.jpg already downloaded
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5669987b57b47a6a0786fcd91f55889.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5669987b57b47a6a0786fcd91f55889.jpg already downloaded
2025-12-05 12:56:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0f252176-08f4-582b-b7c4-19831c1e9111 with identifier 202510147152053
2025-12-05 12:56:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:56:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0f252176-08f4-582b-b7c4-19831c1e9111
2025-12-05 12:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent condition, recently serviced,service '
'history,amazing mileage per gallon, comes with 3 months '
'warranty,12 months AA breakdown cover,new mot,we accept all '
'card payments,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '0f252176-08f4-582b-b7c4-19831c1e9111',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510147152053',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 102000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/467cde015d984b78af983a4a199cdc09.jpg',
'https://m.atcdn.co.uk/a/media/e379dd13c99443ccbd647c752407156a.jpg',
'https://m.atcdn.co.uk/a/media/c2aefb021b7445ff8ec2835e0cbc0ba8.jpg',
'https://m.atcdn.co.uk/a/media/3e25636c55ee4679b43633600a596b81.jpg',
'https://m.atcdn.co.uk/a/media/90d79892c61945459dd0ba80886b9e8b.jpg',
'https://m.atcdn.co.uk/a/media/9bd4098f710d45a28c8280bb6d2c0062.jpg',
'https://m.atcdn.co.uk/a/media/8a97a139f2ef4bce9893c5a5e70f7866.jpg',
'https://m.atcdn.co.uk/a/media/6151094e24ec4939a7b7e347db25c6eb.jpg',
'https://m.atcdn.co.uk/a/media/047fe97b9db4438b936bf001c06e74f7.jpg',
'https://m.atcdn.co.uk/a/media/0ef342926f5144978cc03a52332d5e4f.jpg',
'https://m.atcdn.co.uk/a/media/cf2fa7b3fe3c4f87b64c59eaf71a6347.jpg',
'https://m.atcdn.co.uk/a/media/968090d186cd41d7aa57c9eb11780678.jpg',
'https://m.atcdn.co.uk/a/media/b5669987b57b47a6a0786fcd91f55889.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226850,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/467cde015d984b78af983a4a199cdc09.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238628,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e379dd13c99443ccbd647c752407156a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268034,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c2aefb021b7445ff8ec2835e0cbc0ba8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252603,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e25636c55ee4679b43633600a596b81.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249579,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/90d79892c61945459dd0ba80886b9e8b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195994,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9bd4098f710d45a28c8280bb6d2c0062.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177139,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8a97a139f2ef4bce9893c5a5e70f7866.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219156,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6151094e24ec4939a7b7e347db25c6eb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172337,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/047fe97b9db4438b936bf001c06e74f7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256979,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ef342926f5144978cc03a52332d5e4f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223074,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf2fa7b3fe3c4f87b64c59eaf71a6347.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183631,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/968090d186cd41d7aa57c9eb11780678.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f/e0fbfdfe-566d-5b95-81f1-dfa2cf0e527f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102111,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5669987b57b47a6a0786fcd91f55889.jpg',
'Width': 1600}],
'price': 7777,
'price_includes_vat': True,
'registration_date': '2019-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Octavia 1.5 TSI ACT SE L DSG Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE L',
'year': 2019}
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510147152053%27 HTTP/1.1" 200 None
2025-12-05 12:56:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510147152053: {'created_time': 1764939418.731928, 'last_price_update_time': 1764939418.731937}
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510147152053') HTTP/1.1" 204 0
2025-12-05 12:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:00 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'Red',
'currency': 'GBP',
'description': 'Very low mileage, great runner, recently serviced,service '
'history,comes with 2 months warranty,12 months AA breakdown '
'cover, new mot, we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.3L',
'engine_horse_power': 85,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510207293336',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 34500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ecbcf678c08346dc8b5af41f27ff2d0f.jpg',
'https://m.atcdn.co.uk/a/media/4bd309bdbeef4610a7c28ac11f263ae5.jpg',
'https://m.atcdn.co.uk/a/media/c3e4d3d816a44b778d8cf41cf28c6121.jpg',
'https://m.atcdn.co.uk/a/media/7439aec4fbc54a34affb6e530f8d5a4c.jpg',
'https://m.atcdn.co.uk/a/media/6da36e401d8b4eba8df03e4266f24d51.jpg',
'https://m.atcdn.co.uk/a/media/27ad36f3c20e42a5a1ad27dd4b02095c.jpg',
'https://m.atcdn.co.uk/a/media/44ee5c301d1e44f6b9b24d185b57642c.jpg',
'https://m.atcdn.co.uk/a/media/e5de56ce806548db94762f7e30d25fb9.jpg',
'https://m.atcdn.co.uk/a/media/ec96e6fa51ca404a99fcf9efc688bd10.jpg',
'https://m.atcdn.co.uk/a/media/5730eccfe73345c58e78d7821a09aad9.jpg',
'https://m.atcdn.co.uk/a/media/ac15141afcc64df1a553ddcba440e219.jpg',
'https://m.atcdn.co.uk/a/media/89413c7434594c3cb00d729879aec9ff.jpg',
'https://m.atcdn.co.uk/a/media/abf98380a5e940108f69fc95ee1f27aa.jpg'],
'price': 2299,
'price_includes_vat': True,
'registration_date': '2008-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i T3 5dr',
'transmission': 'manual',
'trim': 'T3',
'year': 2008}
2025-12-05 12:57:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c52527db-3169-58b7-a950-e7270a19baee with identifier: 202510207293336
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item c52527db-3169-58b7-a950-e7270a19baee
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fecbcf678c08346dc8b5af41f27ff2d0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ecbcf678c08346dc8b5af41f27ff2d0f.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bd309bdbeef4610a7c28ac11f263ae5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bd309bdbeef4610a7c28ac11f263ae5.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3e4d3d816a44b778d8cf41cf28c6121.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3e4d3d816a44b778d8cf41cf28c6121.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7439aec4fbc54a34affb6e530f8d5a4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7439aec4fbc54a34affb6e530f8d5a4c.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6da36e401d8b4eba8df03e4266f24d51.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6da36e401d8b4eba8df03e4266f24d51.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27ad36f3c20e42a5a1ad27dd4b02095c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27ad36f3c20e42a5a1ad27dd4b02095c.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44ee5c301d1e44f6b9b24d185b57642c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44ee5c301d1e44f6b9b24d185b57642c.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe5de56ce806548db94762f7e30d25fb9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e5de56ce806548db94762f7e30d25fb9.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec96e6fa51ca404a99fcf9efc688bd10.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec96e6fa51ca404a99fcf9efc688bd10.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5730eccfe73345c58e78d7821a09aad9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5730eccfe73345c58e78d7821a09aad9.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac15141afcc64df1a553ddcba440e219.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac15141afcc64df1a553ddcba440e219.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89413c7434594c3cb00d729879aec9ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89413c7434594c3cb00d729879aec9ff.jpg already downloaded
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fabf98380a5e940108f69fc95ee1f27aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/abf98380a5e940108f69fc95ee1f27aa.jpg already downloaded
2025-12-05 12:57:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c52527db-3169-58b7-a950-e7270a19baee with identifier 202510207293336
2025-12-05 12:57:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c52527db-3169-58b7-a950-e7270a19baee
2025-12-05 12:57:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 141,
'color': 'Red',
'currency': 'GBP',
'description': 'Very low mileage, great runner, recently serviced,service '
'history,comes with 2 months warranty,12 months AA breakdown '
'cover, new mot, we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.3L',
'engine_horse_power': 85,
'fuel_type': 'Petrol',
'id': 'c52527db-3169-58b7-a950-e7270a19baee',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510207293336',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 34500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ecbcf678c08346dc8b5af41f27ff2d0f.jpg',
'https://m.atcdn.co.uk/a/media/4bd309bdbeef4610a7c28ac11f263ae5.jpg',
'https://m.atcdn.co.uk/a/media/c3e4d3d816a44b778d8cf41cf28c6121.jpg',
'https://m.atcdn.co.uk/a/media/7439aec4fbc54a34affb6e530f8d5a4c.jpg',
'https://m.atcdn.co.uk/a/media/6da36e401d8b4eba8df03e4266f24d51.jpg',
'https://m.atcdn.co.uk/a/media/27ad36f3c20e42a5a1ad27dd4b02095c.jpg',
'https://m.atcdn.co.uk/a/media/44ee5c301d1e44f6b9b24d185b57642c.jpg',
'https://m.atcdn.co.uk/a/media/e5de56ce806548db94762f7e30d25fb9.jpg',
'https://m.atcdn.co.uk/a/media/ec96e6fa51ca404a99fcf9efc688bd10.jpg',
'https://m.atcdn.co.uk/a/media/5730eccfe73345c58e78d7821a09aad9.jpg',
'https://m.atcdn.co.uk/a/media/ac15141afcc64df1a553ddcba440e219.jpg',
'https://m.atcdn.co.uk/a/media/89413c7434594c3cb00d729879aec9ff.jpg',
'https://m.atcdn.co.uk/a/media/abf98380a5e940108f69fc95ee1f27aa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229838,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ecbcf678c08346dc8b5af41f27ff2d0f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225534,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bd309bdbeef4610a7c28ac11f263ae5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246896,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3e4d3d816a44b778d8cf41cf28c6121.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270626,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7439aec4fbc54a34affb6e530f8d5a4c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269888,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6da36e401d8b4eba8df03e4266f24d51.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256588,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/27ad36f3c20e42a5a1ad27dd4b02095c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174397,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/44ee5c301d1e44f6b9b24d185b57642c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134706,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e5de56ce806548db94762f7e30d25fb9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197028,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec96e6fa51ca404a99fcf9efc688bd10.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153355,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5730eccfe73345c58e78d7821a09aad9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181678,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac15141afcc64df1a553ddcba440e219.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120657,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/89413c7434594c3cb00d729879aec9ff.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81/e6e1d8ad-a7b9-5249-bfc9-8b2ddbe28e81_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73136,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/abf98380a5e940108f69fc95ee1f27aa.jpg',
'Width': 1600}],
'price': 2299,
'price_includes_vat': True,
'registration_date': '2008-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i T3 5dr',
'transmission': 'manual',
'trim': 'T3',
'year': 2008}
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510207293336%27 HTTP/1.1" 200 None
2025-12-05 12:57:00 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510207293336: {'created_time': 1764939420.548749, 'last_price_update_time': 1764939420.548761}
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510207293336') HTTP/1.1" 204 0
2025-12-05 12:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:10 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent condition,low mileage, 2 keys, recently '
'serviced,service history,comes with 3 months warranty,12 '
'months AA breakdown cover,new mot',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306772232',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Renault',
'model': 'Captur',
'odometer': 41815,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6c5879a5a46040baba9f633b2a91f9b3.jpg',
'https://m.atcdn.co.uk/a/media/51f57a2e87b64598ae6656efeb67e266.jpg',
'https://m.atcdn.co.uk/a/media/5b3d76102fe745928550b2be6cc322cb.jpg',
'https://m.atcdn.co.uk/a/media/bac160419c68453cba4cc43afe131159.jpg',
'https://m.atcdn.co.uk/a/media/880006aeb9124e0e82d533bdbefd12be.jpg',
'https://m.atcdn.co.uk/a/media/66116bc2fc694cf5b2e4540535ba7c90.jpg',
'https://m.atcdn.co.uk/a/media/306ead7fae404af290a6dc9abad73532.jpg',
'https://m.atcdn.co.uk/a/media/6cef922cd9ba4ada90e1c0d06fed552c.jpg',
'https://m.atcdn.co.uk/a/media/2bbd51d171d64241834041c9f42a5b4a.jpg',
'https://m.atcdn.co.uk/a/media/9548da0c4a954eab86f316098fcf426c.jpg',
'https://m.atcdn.co.uk/a/media/3dc9346af998429cac30b8c7cdbc057d.jpg',
'https://m.atcdn.co.uk/a/media/0f466eb3c560496ba3db157ccab8e12c.jpg',
'https://m.atcdn.co.uk/a/media/3729b811638b4c979a3008dd805a4ccf.jpg'],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2017-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi ENERGY Dynamique S Nav EDC Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Dynamique S Nav',
'year': 2017}
2025-12-05 12:57:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 14822064-2761-558b-ac2f-f46477145c80 with identifier: 202509306772232
2025-12-05 12:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 14822064-2761-558b-ac2f-f46477145c80
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c5879a5a46040baba9f633b2a91f9b3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c5879a5a46040baba9f633b2a91f9b3.jpg already downloaded
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51f57a2e87b64598ae6656efeb67e266.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51f57a2e87b64598ae6656efeb67e266.jpg already downloaded
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b3d76102fe745928550b2be6cc322cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b3d76102fe745928550b2be6cc322cb.jpg already downloaded
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbac160419c68453cba4cc43afe131159.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bac160419c68453cba4cc43afe131159.jpg already downloaded
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F880006aeb9124e0e82d533bdbefd12be.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/880006aeb9124e0e82d533bdbefd12be.jpg already downloaded
2025-12-05 12:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F66116bc2fc694cf5b2e4540535ba7c90.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/66116bc2fc694cf5b2e4540535ba7c90.jpg already downloaded
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F306ead7fae404af290a6dc9abad73532.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/306ead7fae404af290a6dc9abad73532.jpg already downloaded
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6cef922cd9ba4ada90e1c0d06fed552c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6cef922cd9ba4ada90e1c0d06fed552c.jpg already downloaded
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2bbd51d171d64241834041c9f42a5b4a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2bbd51d171d64241834041c9f42a5b4a.jpg already downloaded
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9548da0c4a954eab86f316098fcf426c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9548da0c4a954eab86f316098fcf426c.jpg already downloaded
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3dc9346af998429cac30b8c7cdbc057d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3dc9346af998429cac30b8c7cdbc057d.jpg already downloaded
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f466eb3c560496ba3db157ccab8e12c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f466eb3c560496ba3db157ccab8e12c.jpg already downloaded
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3729b811638b4c979a3008dd805a4ccf.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3729b811638b4c979a3008dd805a4ccf.jpg already downloaded
2025-12-05 12:57:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 14822064-2761-558b-ac2f-f46477145c80 with identifier 202509306772232
2025-12-05 12:57:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 14822064-2761-558b-ac2f-f46477145c80
2025-12-05 12:57:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent condition,low mileage, 2 keys, recently '
'serviced,service history,comes with 3 months warranty,12 '
'months AA breakdown cover,new mot',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': '14822064-2761-558b-ac2f-f46477145c80',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306772232',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Renault',
'model': 'Captur',
'odometer': 41815,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6c5879a5a46040baba9f633b2a91f9b3.jpg',
'https://m.atcdn.co.uk/a/media/51f57a2e87b64598ae6656efeb67e266.jpg',
'https://m.atcdn.co.uk/a/media/5b3d76102fe745928550b2be6cc322cb.jpg',
'https://m.atcdn.co.uk/a/media/bac160419c68453cba4cc43afe131159.jpg',
'https://m.atcdn.co.uk/a/media/880006aeb9124e0e82d533bdbefd12be.jpg',
'https://m.atcdn.co.uk/a/media/66116bc2fc694cf5b2e4540535ba7c90.jpg',
'https://m.atcdn.co.uk/a/media/306ead7fae404af290a6dc9abad73532.jpg',
'https://m.atcdn.co.uk/a/media/6cef922cd9ba4ada90e1c0d06fed552c.jpg',
'https://m.atcdn.co.uk/a/media/2bbd51d171d64241834041c9f42a5b4a.jpg',
'https://m.atcdn.co.uk/a/media/9548da0c4a954eab86f316098fcf426c.jpg',
'https://m.atcdn.co.uk/a/media/3dc9346af998429cac30b8c7cdbc057d.jpg',
'https://m.atcdn.co.uk/a/media/0f466eb3c560496ba3db157ccab8e12c.jpg',
'https://m.atcdn.co.uk/a/media/3729b811638b4c979a3008dd805a4ccf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260907,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6c5879a5a46040baba9f633b2a91f9b3.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213673,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51f57a2e87b64598ae6656efeb67e266.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326594,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5b3d76102fe745928550b2be6cc322cb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152829,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bac160419c68453cba4cc43afe131159.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275859,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/880006aeb9124e0e82d533bdbefd12be.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179525,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/66116bc2fc694cf5b2e4540535ba7c90.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286438,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/306ead7fae404af290a6dc9abad73532.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286366,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6cef922cd9ba4ada90e1c0d06fed552c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159099,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2bbd51d171d64241834041c9f42a5b4a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161946,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9548da0c4a954eab86f316098fcf426c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186743,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3dc9346af998429cac30b8c7cdbc057d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176966,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f466eb3c560496ba3db157ccab8e12c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ac2a57e-7074-550d-b475-33978e9e7acc/8ac2a57e-7074-550d-b475-33978e9e7acc_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138447,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3729b811638b4c979a3008dd805a4ccf.jpg',
'Width': 1600}],
'price': 8999,
'price_includes_vat': True,
'registration_date': '2017-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi ENERGY Dynamique S Nav EDC Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Dynamique S Nav',
'year': 2017}
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306772232%27 HTTP/1.1" 200 None
2025-12-05 12:57:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509306772232: {'created_time': 1764939431.177209, 'last_price_update_time': 1764939431.177218}
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509306772232') HTTP/1.1" 204 0
2025-12-05 12:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:18 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 84,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history, 2 keys, full service history, 12 months mot, 12 '
'months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 99,
'fuel_type': 'Petrol Hybrid',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510297502482',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 75308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/cfbffcddba474f0b89e326358a766376.jpg',
'https://m.atcdn.co.uk/a/media/e3df0909e60a496fbf7e3d367c115164.jpg',
'https://m.atcdn.co.uk/a/media/cfaa6032cda94770b30abb642479f164.jpg',
'https://m.atcdn.co.uk/a/media/a12105cba1624a6c9a1a764a2ebe91ac.jpg',
'https://m.atcdn.co.uk/a/media/bfca7386a2ae45108ec6853cb83cfc61.jpg',
'https://m.atcdn.co.uk/a/media/01746afc96bf47bd9849899cfe2b4490.jpg',
'https://m.atcdn.co.uk/a/media/aa20ef21987e42629fba14feedfca77a.jpg',
'https://m.atcdn.co.uk/a/media/534e53a8bfa64c7684edb0be03e445ad.jpg',
'https://m.atcdn.co.uk/a/media/b2b18436c6e2498da7340504330c7234.jpg',
'https://m.atcdn.co.uk/a/media/c6db38a1fa1c4b118f87b52457df4155.jpg',
'https://m.atcdn.co.uk/a/media/48b7d7a4ed34432a9176693ffd975811.jpg',
'https://m.atcdn.co.uk/a/media/baaed7253a174f898fc4000ebae2b66c.jpg'],
'price': 9999,
'price_includes_vat': True,
'registration_date': '2019-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 VVT-h Icon Tech E-CVT Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Icon Tech',
'year': 2019}
2025-12-05 12:57:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a82b3c4-ff72-55e1-821f-367ee31ff0e8 with identifier: 202510297502482
2025-12-05 12:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 9a82b3c4-ff72-55e1-821f-367ee31ff0e8
2025-12-05 12:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcfbffcddba474f0b89e326358a766376.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cfbffcddba474f0b89e326358a766376.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe3df0909e60a496fbf7e3d367c115164.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e3df0909e60a496fbf7e3d367c115164.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcfaa6032cda94770b30abb642479f164.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cfaa6032cda94770b30abb642479f164.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa12105cba1624a6c9a1a764a2ebe91ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a12105cba1624a6c9a1a764a2ebe91ac.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbfca7386a2ae45108ec6853cb83cfc61.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bfca7386a2ae45108ec6853cb83cfc61.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01746afc96bf47bd9849899cfe2b4490.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01746afc96bf47bd9849899cfe2b4490.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa20ef21987e42629fba14feedfca77a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa20ef21987e42629fba14feedfca77a.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F534e53a8bfa64c7684edb0be03e445ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/534e53a8bfa64c7684edb0be03e445ad.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb2b18436c6e2498da7340504330c7234.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b2b18436c6e2498da7340504330c7234.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6db38a1fa1c4b118f87b52457df4155.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6db38a1fa1c4b118f87b52457df4155.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48b7d7a4ed34432a9176693ffd975811.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48b7d7a4ed34432a9176693ffd975811.jpg already downloaded
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbaaed7253a174f898fc4000ebae2b66c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/baaed7253a174f898fc4000ebae2b66c.jpg already downloaded
2025-12-05 12:57:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9a82b3c4-ff72-55e1-821f-367ee31ff0e8 with identifier 202510297502482
2025-12-05 12:57:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9a82b3c4-ff72-55e1-821f-367ee31ff0e8
2025-12-05 12:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history, 2 keys, full service history, 12 months mot, 12 '
'months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 99,
'fuel_type': 'Petrol Hybrid',
'id': '9a82b3c4-ff72-55e1-821f-367ee31ff0e8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510297502482',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 75308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/cfbffcddba474f0b89e326358a766376.jpg',
'https://m.atcdn.co.uk/a/media/e3df0909e60a496fbf7e3d367c115164.jpg',
'https://m.atcdn.co.uk/a/media/cfaa6032cda94770b30abb642479f164.jpg',
'https://m.atcdn.co.uk/a/media/a12105cba1624a6c9a1a764a2ebe91ac.jpg',
'https://m.atcdn.co.uk/a/media/bfca7386a2ae45108ec6853cb83cfc61.jpg',
'https://m.atcdn.co.uk/a/media/01746afc96bf47bd9849899cfe2b4490.jpg',
'https://m.atcdn.co.uk/a/media/aa20ef21987e42629fba14feedfca77a.jpg',
'https://m.atcdn.co.uk/a/media/534e53a8bfa64c7684edb0be03e445ad.jpg',
'https://m.atcdn.co.uk/a/media/b2b18436c6e2498da7340504330c7234.jpg',
'https://m.atcdn.co.uk/a/media/c6db38a1fa1c4b118f87b52457df4155.jpg',
'https://m.atcdn.co.uk/a/media/48b7d7a4ed34432a9176693ffd975811.jpg',
'https://m.atcdn.co.uk/a/media/baaed7253a174f898fc4000ebae2b66c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254827,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cfbffcddba474f0b89e326358a766376.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223922,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e3df0909e60a496fbf7e3d367c115164.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264471,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cfaa6032cda94770b30abb642479f164.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249675,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a12105cba1624a6c9a1a764a2ebe91ac.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152843,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bfca7386a2ae45108ec6853cb83cfc61.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135231,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/01746afc96bf47bd9849899cfe2b4490.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132144,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa20ef21987e42629fba14feedfca77a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186780,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/534e53a8bfa64c7684edb0be03e445ad.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187225,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b2b18436c6e2498da7340504330c7234.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312407,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6db38a1fa1c4b118f87b52457df4155.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157154,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48b7d7a4ed34432a9176693ffd975811.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11dfab69-44c5-586a-a306-8e570d043075/11dfab69-44c5-586a-a306-8e570d043075_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95325,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/baaed7253a174f898fc4000ebae2b66c.jpg',
'Width': 1600}],
'price': 9999,
'price_includes_vat': True,
'registration_date': '2019-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 VVT-h Icon Tech E-CVT Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Icon Tech',
'year': 2019}
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510297502482%27 HTTP/1.1" 200 None
2025-12-05 12:57:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510297502482: {'created_time': 1764939439.261175, 'last_price_update_time': 1764939439.261184}
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510297502482') HTTP/1.1" 204 0
2025-12-05 12:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:27 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history,new mot,3 months warranty,12 months AA breakdown '
'cover',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921691',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 87133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5d15203f8dc04bd186d6dbe4c1db363d.jpg',
'https://m.atcdn.co.uk/a/media/91a8af8e037246bd91cc60de2bdf4d12.jpg',
'https://m.atcdn.co.uk/a/media/87533ef58b354f48b5dc6ed9fdb530cc.jpg',
'https://m.atcdn.co.uk/a/media/29497093b8754f0795045e4c26b691a5.jpg',
'https://m.atcdn.co.uk/a/media/f2d92317da514d61b09cc00dac6f5817.jpg',
'https://m.atcdn.co.uk/a/media/d8a406449a074766bc8f4956f8aab4c8.jpg',
'https://m.atcdn.co.uk/a/media/56708cf5fb9e455aab98e4bf6a93bb7c.jpg',
'https://m.atcdn.co.uk/a/media/559407dd9f6b41c985076c3b28855dd1.jpg',
'https://m.atcdn.co.uk/a/media/a9678b16dc8b46b4a489cbb0943f8ba6.jpg',
'https://m.atcdn.co.uk/a/media/1071e81530d64bd8be873b56c30c3fd2.jpg',
'https://m.atcdn.co.uk/a/media/17e4413401cc49eeb40ca17f2ccfeb6f.jpg',
'https://m.atcdn.co.uk/a/media/54ffc3ac7e1749bd906d8f8689277f78.jpg',
'https://m.atcdn.co.uk/a/media/b06494bafbb84b73af406d34aa2d08e9.jpg',
'https://m.atcdn.co.uk/a/media/c427c14be339474f811945fd39aeccdd.jpg',
'https://m.atcdn.co.uk/a/media/05fd2ba9548d4abaa9f9f4cd26936e28.jpg',
'https://m.atcdn.co.uk/a/media/144754640fb345df84a5fdf058e1bd9d.jpg',
'https://m.atcdn.co.uk/a/media/4d10052504814dbdb9815eb02779bb3b.jpg',
'https://m.atcdn.co.uk/a/media/4edb2f9c784642319ba983b3cf0e0d3b.jpg'],
'price': 5499,
'price_includes_vat': True,
'registration_date': '2013-04-01',
'seats_number': 7,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.2 DI-D GX4 4WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'GX4',
'year': 2013}
2025-12-05 12:57:27 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c13d68b0-1843-576e-943e-7923df62ce5f with identifier: 202511157921691
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item c13d68b0-1843-576e-943e-7923df62ce5f
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5d15203f8dc04bd186d6dbe4c1db363d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5d15203f8dc04bd186d6dbe4c1db363d.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91a8af8e037246bd91cc60de2bdf4d12.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91a8af8e037246bd91cc60de2bdf4d12.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F87533ef58b354f48b5dc6ed9fdb530cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/87533ef58b354f48b5dc6ed9fdb530cc.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29497093b8754f0795045e4c26b691a5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29497093b8754f0795045e4c26b691a5.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2d92317da514d61b09cc00dac6f5817.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2d92317da514d61b09cc00dac6f5817.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8a406449a074766bc8f4956f8aab4c8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8a406449a074766bc8f4956f8aab4c8.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F56708cf5fb9e455aab98e4bf6a93bb7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/56708cf5fb9e455aab98e4bf6a93bb7c.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F559407dd9f6b41c985076c3b28855dd1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/559407dd9f6b41c985076c3b28855dd1.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa9678b16dc8b46b4a489cbb0943f8ba6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a9678b16dc8b46b4a489cbb0943f8ba6.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1071e81530d64bd8be873b56c30c3fd2.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1071e81530d64bd8be873b56c30c3fd2.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F17e4413401cc49eeb40ca17f2ccfeb6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/17e4413401cc49eeb40ca17f2ccfeb6f.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54ffc3ac7e1749bd906d8f8689277f78.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54ffc3ac7e1749bd906d8f8689277f78.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb06494bafbb84b73af406d34aa2d08e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b06494bafbb84b73af406d34aa2d08e9.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc427c14be339474f811945fd39aeccdd.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c427c14be339474f811945fd39aeccdd.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05fd2ba9548d4abaa9f9f4cd26936e28.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05fd2ba9548d4abaa9f9f4cd26936e28.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F144754640fb345df84a5fdf058e1bd9d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/144754640fb345df84a5fdf058e1bd9d.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4d10052504814dbdb9815eb02779bb3b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4d10052504814dbdb9815eb02779bb3b.jpg already downloaded
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4edb2f9c784642319ba983b3cf0e0d3b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4edb2f9c784642319ba983b3cf0e0d3b.jpg already downloaded
2025-12-05 12:57:27 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c13d68b0-1843-576e-943e-7923df62ce5f with identifier 202511157921691
2025-12-05 12:57:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:27 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c13d68b0-1843-576e-943e-7923df62ce5f
2025-12-05 12:57:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history,new mot,3 months warranty,12 months AA breakdown '
'cover',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'c13d68b0-1843-576e-943e-7923df62ce5f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921691',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 87133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5d15203f8dc04bd186d6dbe4c1db363d.jpg',
'https://m.atcdn.co.uk/a/media/91a8af8e037246bd91cc60de2bdf4d12.jpg',
'https://m.atcdn.co.uk/a/media/87533ef58b354f48b5dc6ed9fdb530cc.jpg',
'https://m.atcdn.co.uk/a/media/29497093b8754f0795045e4c26b691a5.jpg',
'https://m.atcdn.co.uk/a/media/f2d92317da514d61b09cc00dac6f5817.jpg',
'https://m.atcdn.co.uk/a/media/d8a406449a074766bc8f4956f8aab4c8.jpg',
'https://m.atcdn.co.uk/a/media/56708cf5fb9e455aab98e4bf6a93bb7c.jpg',
'https://m.atcdn.co.uk/a/media/559407dd9f6b41c985076c3b28855dd1.jpg',
'https://m.atcdn.co.uk/a/media/a9678b16dc8b46b4a489cbb0943f8ba6.jpg',
'https://m.atcdn.co.uk/a/media/1071e81530d64bd8be873b56c30c3fd2.jpg',
'https://m.atcdn.co.uk/a/media/17e4413401cc49eeb40ca17f2ccfeb6f.jpg',
'https://m.atcdn.co.uk/a/media/54ffc3ac7e1749bd906d8f8689277f78.jpg',
'https://m.atcdn.co.uk/a/media/b06494bafbb84b73af406d34aa2d08e9.jpg',
'https://m.atcdn.co.uk/a/media/c427c14be339474f811945fd39aeccdd.jpg',
'https://m.atcdn.co.uk/a/media/05fd2ba9548d4abaa9f9f4cd26936e28.jpg',
'https://m.atcdn.co.uk/a/media/144754640fb345df84a5fdf058e1bd9d.jpg',
'https://m.atcdn.co.uk/a/media/4d10052504814dbdb9815eb02779bb3b.jpg',
'https://m.atcdn.co.uk/a/media/4edb2f9c784642319ba983b3cf0e0d3b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482844,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5d15203f8dc04bd186d6dbe4c1db363d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393240,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91a8af8e037246bd91cc60de2bdf4d12.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513707,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/87533ef58b354f48b5dc6ed9fdb530cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 568914,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/29497093b8754f0795045e4c26b691a5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519140,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2d92317da514d61b09cc00dac6f5817.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475593,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d8a406449a074766bc8f4956f8aab4c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467370,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/56708cf5fb9e455aab98e4bf6a93bb7c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387868,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/559407dd9f6b41c985076c3b28855dd1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379960,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a9678b16dc8b46b4a489cbb0943f8ba6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375511,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1071e81530d64bd8be873b56c30c3fd2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315251,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/17e4413401cc49eeb40ca17f2ccfeb6f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309891,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/54ffc3ac7e1749bd906d8f8689277f78.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326581,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b06494bafbb84b73af406d34aa2d08e9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364759,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c427c14be339474f811945fd39aeccdd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399020,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/05fd2ba9548d4abaa9f9f4cd26936e28.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364677,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/144754640fb345df84a5fdf058e1bd9d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301600,
'Height': 2730,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4d10052504814dbdb9815eb02779bb3b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8d2723-c3da-5f48-bcf6-f216362a8872/ab8d2723-c3da-5f48-bcf6-f216362a8872_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275144,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4edb2f9c784642319ba983b3cf0e0d3b.jpg',
'Width': 2048}],
'price': 5499,
'price_includes_vat': True,
'registration_date': '2013-04-01',
'seats_number': 7,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.2 DI-D GX4 4WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'GX4',
'year': 2013}
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921691%27 HTTP/1.1" 200 None
2025-12-05 12:57:27 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157921691: {'created_time': 1764939447.700086, 'last_price_update_time': 1764939447.700098}
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157921691') HTTP/1.1" 204 0
2025-12-05 12:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:30 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Silver',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history, low tax and insurance group, comes with 3 months '
'warranty,12 months AA breakdown cover,new mot,we accept all '
'card payments',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.25L',
'engine_horse_power': 81,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509116258293',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 80488,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8bd2922aeaab4db2ae55f63bfc1e8525.jpg',
'https://m.atcdn.co.uk/a/media/5df77b6a514d4619a2da664759a156ef.jpg',
'https://m.atcdn.co.uk/a/media/f4a1c6b0ce8f4360bc667fc6322576dd.jpg',
'https://m.atcdn.co.uk/a/media/3ecd97c2ac2f469ca0e2794d374b137f.jpg',
'https://m.atcdn.co.uk/a/media/087e853285c14448a40f244e5376388a.jpg',
'https://m.atcdn.co.uk/a/media/c641556f03594a5f8d2cdab10f0fa89c.jpg',
'https://m.atcdn.co.uk/a/media/f3236d0bd12747c88c9106c5d4a7ba93.jpg',
'https://m.atcdn.co.uk/a/media/6a29e01a574f4919a73338dad82e389f.jpg',
'https://m.atcdn.co.uk/a/media/834ba0497766484284be4adbbf53fa1f.jpg',
'https://m.atcdn.co.uk/a/media/188c1840752e43be92d5f5805e9963ea.jpg',
'https://m.atcdn.co.uk/a/media/3e5ce28a4bd846cba96b1c521cc52439.jpg',
'https://m.atcdn.co.uk/a/media/362e3d595f544245beea805496cb7ab1.jpg'],
'price': 2899,
'price_includes_vat': True,
'registration_date': '2009-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Zetec 5dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2009}
2025-12-05 12:57:30 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ad062d6a-a301-50b7-a19a-b6d06711ae60 with identifier: 202509116258293
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item ad062d6a-a301-50b7-a19a-b6d06711ae60
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bd2922aeaab4db2ae55f63bfc1e8525.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bd2922aeaab4db2ae55f63bfc1e8525.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5df77b6a514d4619a2da664759a156ef.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5df77b6a514d4619a2da664759a156ef.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4a1c6b0ce8f4360bc667fc6322576dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4a1c6b0ce8f4360bc667fc6322576dd.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ecd97c2ac2f469ca0e2794d374b137f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ecd97c2ac2f469ca0e2794d374b137f.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F087e853285c14448a40f244e5376388a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/087e853285c14448a40f244e5376388a.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc641556f03594a5f8d2cdab10f0fa89c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c641556f03594a5f8d2cdab10f0fa89c.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3236d0bd12747c88c9106c5d4a7ba93.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3236d0bd12747c88c9106c5d4a7ba93.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a29e01a574f4919a73338dad82e389f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a29e01a574f4919a73338dad82e389f.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F834ba0497766484284be4adbbf53fa1f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/834ba0497766484284be4adbbf53fa1f.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F188c1840752e43be92d5f5805e9963ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/188c1840752e43be92d5f5805e9963ea.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e5ce28a4bd846cba96b1c521cc52439.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e5ce28a4bd846cba96b1c521cc52439.jpg already downloaded
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F362e3d595f544245beea805496cb7ab1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/362e3d595f544245beea805496cb7ab1.jpg already downloaded
2025-12-05 12:57:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ad062d6a-a301-50b7-a19a-b6d06711ae60 with identifier 202509116258293
2025-12-05 12:57:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ad062d6a-a301-50b7-a19a-b6d06711ae60
2025-12-05 12:57:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Silver',
'currency': 'GBP',
'description': 'Excellent runner,top version,recently serviced,service '
'history, low tax and insurance group, comes with 3 months '
'warranty,12 months AA breakdown cover,new mot,we accept all '
'card payments',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.25L',
'engine_horse_power': 81,
'fuel_type': 'Petrol',
'id': 'ad062d6a-a301-50b7-a19a-b6d06711ae60',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509116258293',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 80488,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8bd2922aeaab4db2ae55f63bfc1e8525.jpg',
'https://m.atcdn.co.uk/a/media/5df77b6a514d4619a2da664759a156ef.jpg',
'https://m.atcdn.co.uk/a/media/f4a1c6b0ce8f4360bc667fc6322576dd.jpg',
'https://m.atcdn.co.uk/a/media/3ecd97c2ac2f469ca0e2794d374b137f.jpg',
'https://m.atcdn.co.uk/a/media/087e853285c14448a40f244e5376388a.jpg',
'https://m.atcdn.co.uk/a/media/c641556f03594a5f8d2cdab10f0fa89c.jpg',
'https://m.atcdn.co.uk/a/media/f3236d0bd12747c88c9106c5d4a7ba93.jpg',
'https://m.atcdn.co.uk/a/media/6a29e01a574f4919a73338dad82e389f.jpg',
'https://m.atcdn.co.uk/a/media/834ba0497766484284be4adbbf53fa1f.jpg',
'https://m.atcdn.co.uk/a/media/188c1840752e43be92d5f5805e9963ea.jpg',
'https://m.atcdn.co.uk/a/media/3e5ce28a4bd846cba96b1c521cc52439.jpg',
'https://m.atcdn.co.uk/a/media/362e3d595f544245beea805496cb7ab1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243332,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8bd2922aeaab4db2ae55f63bfc1e8525.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224531,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5df77b6a514d4619a2da664759a156ef.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242732,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4a1c6b0ce8f4360bc667fc6322576dd.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227349,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ecd97c2ac2f469ca0e2794d374b137f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137372,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/087e853285c14448a40f244e5376388a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210994,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c641556f03594a5f8d2cdab10f0fa89c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256469,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3236d0bd12747c88c9106c5d4a7ba93.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203689,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a29e01a574f4919a73338dad82e389f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205864,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/834ba0497766484284be4adbbf53fa1f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264854,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/188c1840752e43be92d5f5805e9963ea.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197372,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e5ce28a4bd846cba96b1c521cc52439.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5/3395ab95-498f-5c7c-b60f-aeb7a6f0f2e5_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227261,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/362e3d595f544245beea805496cb7ab1.jpg',
'Width': 1600}],
'price': 2899,
'price_includes_vat': True,
'registration_date': '2009-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Zetec 5dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2009}
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116258293%27 HTTP/1.1" 200 None
2025-12-05 12:57:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509116258293: {'created_time': 1764939450.274797, 'last_price_update_time': 1764939450.274805}
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509116258293') HTTP/1.1" 204 0
2025-12-05 12:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:31 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent runner, top version,recently serviced,service '
'history, 2 keys, comes with new mot,12 months AA breakdown '
'cover',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921785',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 150000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/192fe114f2294acbbfc311ec94781396.jpg',
'https://m.atcdn.co.uk/a/media/5f4ec28c7be54f9f8665fc60602705af.jpg',
'https://m.atcdn.co.uk/a/media/ae5f4115eec34ed5bc68b8a5535c0778.jpg',
'https://m.atcdn.co.uk/a/media/0351c0f7fe6c4dc9be024084cb563987.jpg',
'https://m.atcdn.co.uk/a/media/89e16c602002413599d72fba39ccc4be.jpg',
'https://m.atcdn.co.uk/a/media/3b30e4eb23c9413da3b32d02ca405026.jpg',
'https://m.atcdn.co.uk/a/media/c53d6e2ac63c4ad9b2d9359b27eef74b.jpg',
'https://m.atcdn.co.uk/a/media/148377d310cd4a5f93467433c5799825.jpg',
'https://m.atcdn.co.uk/a/media/463c538633f74b5489477bc2c45dfa21.jpg',
'https://m.atcdn.co.uk/a/media/585c0a2b79dc409796b1440bf78ca93a.jpg',
'https://m.atcdn.co.uk/a/media/d1ee72fa972b4a6ca9ec9d68881e1fcf.jpg',
'https://m.atcdn.co.uk/a/media/93fa75d186984d20a7d12c5c2b809365.jpg',
'https://m.atcdn.co.uk/a/media/05faf204eec44838be9150dd82581958.jpg'],
'price': 3899,
'price_includes_vat': True,
'registration_date': '2014-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI BlueMotion Tech Match 2WD Euro 5 (s/s) '
'5dr',
'transmission': 'manual',
'trim': 'Match',
'year': 2014}
2025-12-05 12:57:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 470c72e4-0270-520f-bf8c-2b9a2134c50d with identifier: 202511157921785
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 470c72e4-0270-520f-bf8c-2b9a2134c50d
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F192fe114f2294acbbfc311ec94781396.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/192fe114f2294acbbfc311ec94781396.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f4ec28c7be54f9f8665fc60602705af.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f4ec28c7be54f9f8665fc60602705af.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fae5f4115eec34ed5bc68b8a5535c0778.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ae5f4115eec34ed5bc68b8a5535c0778.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0351c0f7fe6c4dc9be024084cb563987.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0351c0f7fe6c4dc9be024084cb563987.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89e16c602002413599d72fba39ccc4be.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89e16c602002413599d72fba39ccc4be.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b30e4eb23c9413da3b32d02ca405026.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b30e4eb23c9413da3b32d02ca405026.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc53d6e2ac63c4ad9b2d9359b27eef74b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c53d6e2ac63c4ad9b2d9359b27eef74b.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F148377d310cd4a5f93467433c5799825.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/148377d310cd4a5f93467433c5799825.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F463c538633f74b5489477bc2c45dfa21.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/463c538633f74b5489477bc2c45dfa21.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F585c0a2b79dc409796b1440bf78ca93a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/585c0a2b79dc409796b1440bf78ca93a.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1ee72fa972b4a6ca9ec9d68881e1fcf.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1ee72fa972b4a6ca9ec9d68881e1fcf.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93fa75d186984d20a7d12c5c2b809365.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93fa75d186984d20a7d12c5c2b809365.jpg already downloaded
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05faf204eec44838be9150dd82581958.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05faf204eec44838be9150dd82581958.jpg already downloaded
2025-12-05 12:57:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 470c72e4-0270-520f-bf8c-2b9a2134c50d with identifier 202511157921785
2025-12-05 12:57:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 470c72e4-0270-520f-bf8c-2b9a2134c50d
2025-12-05 12:57:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent runner, top version,recently serviced,service '
'history, 2 keys, comes with new mot,12 months AA breakdown '
'cover',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'id': '470c72e4-0270-520f-bf8c-2b9a2134c50d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921785',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 150000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/192fe114f2294acbbfc311ec94781396.jpg',
'https://m.atcdn.co.uk/a/media/5f4ec28c7be54f9f8665fc60602705af.jpg',
'https://m.atcdn.co.uk/a/media/ae5f4115eec34ed5bc68b8a5535c0778.jpg',
'https://m.atcdn.co.uk/a/media/0351c0f7fe6c4dc9be024084cb563987.jpg',
'https://m.atcdn.co.uk/a/media/89e16c602002413599d72fba39ccc4be.jpg',
'https://m.atcdn.co.uk/a/media/3b30e4eb23c9413da3b32d02ca405026.jpg',
'https://m.atcdn.co.uk/a/media/c53d6e2ac63c4ad9b2d9359b27eef74b.jpg',
'https://m.atcdn.co.uk/a/media/148377d310cd4a5f93467433c5799825.jpg',
'https://m.atcdn.co.uk/a/media/463c538633f74b5489477bc2c45dfa21.jpg',
'https://m.atcdn.co.uk/a/media/585c0a2b79dc409796b1440bf78ca93a.jpg',
'https://m.atcdn.co.uk/a/media/d1ee72fa972b4a6ca9ec9d68881e1fcf.jpg',
'https://m.atcdn.co.uk/a/media/93fa75d186984d20a7d12c5c2b809365.jpg',
'https://m.atcdn.co.uk/a/media/05faf204eec44838be9150dd82581958.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273378,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/192fe114f2294acbbfc311ec94781396.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228209,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f4ec28c7be54f9f8665fc60602705af.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295283,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ae5f4115eec34ed5bc68b8a5535c0778.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188382,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0351c0f7fe6c4dc9be024084cb563987.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304700,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/89e16c602002413599d72fba39ccc4be.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318949,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b30e4eb23c9413da3b32d02ca405026.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250059,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c53d6e2ac63c4ad9b2d9359b27eef74b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131695,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/148377d310cd4a5f93467433c5799825.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196036,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/463c538633f74b5489477bc2c45dfa21.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128859,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/585c0a2b79dc409796b1440bf78ca93a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108953,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1ee72fa972b4a6ca9ec9d68881e1fcf.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108081,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/93fa75d186984d20a7d12c5c2b809365.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d864dc9b-fb54-53ac-ab02-10f516c9e47f/d864dc9b-fb54-53ac-ab02-10f516c9e47f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87293,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/05faf204eec44838be9150dd82581958.jpg',
'Width': 1600}],
'price': 3899,
'price_includes_vat': True,
'registration_date': '2014-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI BlueMotion Tech Match 2WD Euro 5 (s/s) '
'5dr',
'transmission': 'manual',
'trim': 'Match',
'year': 2014}
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921785%27 HTTP/1.1" 200 None
2025-12-05 12:57:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157921785: {'created_time': 1764939451.316987, 'last_price_update_time': 1764939451.316994}
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157921785') HTTP/1.1" 204 0
2025-12-05 12:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:32 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent runner, top version, panoramic roof, recently '
'serviced, timing chain replaced ( recently ), comes with new '
'mot, 3 months warranty,12 months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 178,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921808',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 103250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8c124e5a32074275a7d299dfe3c1535e.jpg',
'https://m.atcdn.co.uk/a/media/139cd0ab35ba42868ddc84e718da66b0.jpg',
'https://m.atcdn.co.uk/a/media/4bb77575315248bb8ea0e215fd8bd268.jpg',
'https://m.atcdn.co.uk/a/media/f5c4f37f4445432cafdce9e2175d655b.jpg',
'https://m.atcdn.co.uk/a/media/b8d6d6aa9b204d85bd317c5f1fcb230f.jpg',
'https://m.atcdn.co.uk/a/media/91ac453b281c4efa9f2808410c039255.jpg',
'https://m.atcdn.co.uk/a/media/30c240ce456b450b9c4aceb8728096b4.jpg',
'https://m.atcdn.co.uk/a/media/f20ff5928d6e483091ffe0f6d9e40792.jpg',
'https://m.atcdn.co.uk/a/media/35864bea50814f9bbae2c93acbba802f.jpg',
'https://m.atcdn.co.uk/a/media/507edbdf03bf45d99e41c95f69c0c90b.jpg',
'https://m.atcdn.co.uk/a/media/f4ea0b759b0043778f956e32a6d5bf2f.jpg',
'https://m.atcdn.co.uk/a/media/96105ac8eb6d4c9ca9e97bd71c98bc8a.jpg',
'https://m.atcdn.co.uk/a/media/2fe1342d47c4443bbe393e4d7dd46481.jpg'],
'price': 8888,
'price_includes_vat': True,
'registration_date': '2016-01-02',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 TD4 HSE Auto 4WD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2016}
2025-12-05 12:57:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e195e91-7518-5372-885f-5a4a09bb5744 with identifier: 202511157921808
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 7e195e91-7518-5372-885f-5a4a09bb5744
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c124e5a32074275a7d299dfe3c1535e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c124e5a32074275a7d299dfe3c1535e.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F139cd0ab35ba42868ddc84e718da66b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/139cd0ab35ba42868ddc84e718da66b0.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bb77575315248bb8ea0e215fd8bd268.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bb77575315248bb8ea0e215fd8bd268.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5c4f37f4445432cafdce9e2175d655b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5c4f37f4445432cafdce9e2175d655b.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8d6d6aa9b204d85bd317c5f1fcb230f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8d6d6aa9b204d85bd317c5f1fcb230f.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91ac453b281c4efa9f2808410c039255.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91ac453b281c4efa9f2808410c039255.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30c240ce456b450b9c4aceb8728096b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30c240ce456b450b9c4aceb8728096b4.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff20ff5928d6e483091ffe0f6d9e40792.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f20ff5928d6e483091ffe0f6d9e40792.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F35864bea50814f9bbae2c93acbba802f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/35864bea50814f9bbae2c93acbba802f.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F507edbdf03bf45d99e41c95f69c0c90b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/507edbdf03bf45d99e41c95f69c0c90b.jpg already downloaded
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4ea0b759b0043778f956e32a6d5bf2f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4ea0b759b0043778f956e32a6d5bf2f.jpg already downloaded
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F96105ac8eb6d4c9ca9e97bd71c98bc8a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/96105ac8eb6d4c9ca9e97bd71c98bc8a.jpg already downloaded
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2fe1342d47c4443bbe393e4d7dd46481.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2fe1342d47c4443bbe393e4d7dd46481.jpg already downloaded
2025-12-05 12:57:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7e195e91-7518-5372-885f-5a4a09bb5744 with identifier 202511157921808
2025-12-05 12:57:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7e195e91-7518-5372-885f-5a4a09bb5744
2025-12-05 12:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent runner, top version, panoramic roof, recently '
'serviced, timing chain replaced ( recently ), comes with new '
'mot, 3 months warranty,12 months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 178,
'fuel_type': 'Diesel',
'id': '7e195e91-7518-5372-885f-5a4a09bb5744',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921808',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 103250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8c124e5a32074275a7d299dfe3c1535e.jpg',
'https://m.atcdn.co.uk/a/media/139cd0ab35ba42868ddc84e718da66b0.jpg',
'https://m.atcdn.co.uk/a/media/4bb77575315248bb8ea0e215fd8bd268.jpg',
'https://m.atcdn.co.uk/a/media/f5c4f37f4445432cafdce9e2175d655b.jpg',
'https://m.atcdn.co.uk/a/media/b8d6d6aa9b204d85bd317c5f1fcb230f.jpg',
'https://m.atcdn.co.uk/a/media/91ac453b281c4efa9f2808410c039255.jpg',
'https://m.atcdn.co.uk/a/media/30c240ce456b450b9c4aceb8728096b4.jpg',
'https://m.atcdn.co.uk/a/media/f20ff5928d6e483091ffe0f6d9e40792.jpg',
'https://m.atcdn.co.uk/a/media/35864bea50814f9bbae2c93acbba802f.jpg',
'https://m.atcdn.co.uk/a/media/507edbdf03bf45d99e41c95f69c0c90b.jpg',
'https://m.atcdn.co.uk/a/media/f4ea0b759b0043778f956e32a6d5bf2f.jpg',
'https://m.atcdn.co.uk/a/media/96105ac8eb6d4c9ca9e97bd71c98bc8a.jpg',
'https://m.atcdn.co.uk/a/media/2fe1342d47c4443bbe393e4d7dd46481.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349691,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c124e5a32074275a7d299dfe3c1535e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300141,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/139cd0ab35ba42868ddc84e718da66b0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319537,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bb77575315248bb8ea0e215fd8bd268.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247352,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5c4f37f4445432cafdce9e2175d655b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298304,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b8d6d6aa9b204d85bd317c5f1fcb230f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202749,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91ac453b281c4efa9f2808410c039255.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195502,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/30c240ce456b450b9c4aceb8728096b4.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191671,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f20ff5928d6e483091ffe0f6d9e40792.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203811,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/35864bea50814f9bbae2c93acbba802f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208963,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/507edbdf03bf45d99e41c95f69c0c90b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303313,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4ea0b759b0043778f956e32a6d5bf2f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288888,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/96105ac8eb6d4c9ca9e97bd71c98bc8a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6832d8b3-9c92-5e30-a0e7-51d673c0acc8/6832d8b3-9c92-5e30-a0e7-51d673c0acc8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71650,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2fe1342d47c4443bbe393e4d7dd46481.jpg',
'Width': 1600}],
'price': 8888,
'price_includes_vat': True,
'registration_date': '2016-01-02',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 TD4 HSE Auto 4WD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2016}
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921808%27 HTTP/1.1" 200 None
2025-12-05 12:57:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157921808: {'created_time': 1764939453.062054, 'last_price_update_time': 1764939453.062063}
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157921808') HTTP/1.1" 204 0
2025-12-05 12:57:37 [scrapy.extensions.logstats] INFO: Crawled 28 pages (at 13 pages/min), scraped 26 items (at 13 items/min)
2025-12-05 12:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:45 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 172,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent runner, clean car',
'doors_number': 2,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 208,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208020722',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Audi',
'model': 'A5',
'odometer': 87000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f8735aab3e074fff87cfc352575f49f9.jpg',
'https://m.atcdn.co.uk/a/media/c6a7c04daeae424aae7a22829474ec50.jpg',
'https://m.atcdn.co.uk/a/media/28a038717c3543c59dd4e80625eaa659.jpg',
'https://m.atcdn.co.uk/a/media/bfbee884f6104cb6ba7b2232253b50aa.jpg',
'https://m.atcdn.co.uk/a/media/09a9783d5d6f4e6aafd4b41b57ffc4f3.jpg',
'https://m.atcdn.co.uk/a/media/f2ddcd38ab1f4741b4bdf68f660cddf5.jpg',
'https://m.atcdn.co.uk/a/media/e08d069a41e84e0699f5a8858cadcc25.jpg',
'https://m.atcdn.co.uk/a/media/3f49c9f995e747a385aabed15ef0b129.jpg',
'https://m.atcdn.co.uk/a/media/41df820207d9482586d1bb2f0a2aa129.jpg',
'https://m.atcdn.co.uk/a/media/d9754a8f7c2b4344a4d73d93e8461844.jpg',
'https://m.atcdn.co.uk/a/media/a2c6dedf1d08469d9d95d802e215ca41.jpg',
'https://m.atcdn.co.uk/a/media/5e4bd530d26d44b6a4852f9305f39086.jpg',
'https://m.atcdn.co.uk/a/media/3f5e7e046e7843fda25af946eeb688af.jpg'],
'price': 4299,
'price_includes_vat': True,
'registration_date': '2009-03-01',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A5 2.0 TFSI Sport quattro Euro 4 2dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2025-12-05 12:57:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: df8333e0-22c7-5c2c-bb10-036685f7b264 with identifier: 202511208020722
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item df8333e0-22c7-5c2c-bb10-036685f7b264
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff8735aab3e074fff87cfc352575f49f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f8735aab3e074fff87cfc352575f49f9.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6a7c04daeae424aae7a22829474ec50.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6a7c04daeae424aae7a22829474ec50.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28a038717c3543c59dd4e80625eaa659.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28a038717c3543c59dd4e80625eaa659.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbfbee884f6104cb6ba7b2232253b50aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bfbee884f6104cb6ba7b2232253b50aa.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09a9783d5d6f4e6aafd4b41b57ffc4f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09a9783d5d6f4e6aafd4b41b57ffc4f3.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2ddcd38ab1f4741b4bdf68f660cddf5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2ddcd38ab1f4741b4bdf68f660cddf5.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe08d069a41e84e0699f5a8858cadcc25.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e08d069a41e84e0699f5a8858cadcc25.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f49c9f995e747a385aabed15ef0b129.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f49c9f995e747a385aabed15ef0b129.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F41df820207d9482586d1bb2f0a2aa129.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/41df820207d9482586d1bb2f0a2aa129.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd9754a8f7c2b4344a4d73d93e8461844.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d9754a8f7c2b4344a4d73d93e8461844.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2c6dedf1d08469d9d95d802e215ca41.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2c6dedf1d08469d9d95d802e215ca41.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e4bd530d26d44b6a4852f9305f39086.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e4bd530d26d44b6a4852f9305f39086.jpg already downloaded
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f5e7e046e7843fda25af946eeb688af.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f5e7e046e7843fda25af946eeb688af.jpg already downloaded
2025-12-05 12:57:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: df8333e0-22c7-5c2c-bb10-036685f7b264 with identifier 202511208020722
2025-12-05 12:57:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item df8333e0-22c7-5c2c-bb10-036685f7b264
2025-12-05 12:57:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 172,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent runner, clean car',
'doors_number': 2,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 208,
'fuel_type': 'Petrol',
'id': 'df8333e0-22c7-5c2c-bb10-036685f7b264',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208020722',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Audi',
'model': 'A5',
'odometer': 87000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f8735aab3e074fff87cfc352575f49f9.jpg',
'https://m.atcdn.co.uk/a/media/c6a7c04daeae424aae7a22829474ec50.jpg',
'https://m.atcdn.co.uk/a/media/28a038717c3543c59dd4e80625eaa659.jpg',
'https://m.atcdn.co.uk/a/media/bfbee884f6104cb6ba7b2232253b50aa.jpg',
'https://m.atcdn.co.uk/a/media/09a9783d5d6f4e6aafd4b41b57ffc4f3.jpg',
'https://m.atcdn.co.uk/a/media/f2ddcd38ab1f4741b4bdf68f660cddf5.jpg',
'https://m.atcdn.co.uk/a/media/e08d069a41e84e0699f5a8858cadcc25.jpg',
'https://m.atcdn.co.uk/a/media/3f49c9f995e747a385aabed15ef0b129.jpg',
'https://m.atcdn.co.uk/a/media/41df820207d9482586d1bb2f0a2aa129.jpg',
'https://m.atcdn.co.uk/a/media/d9754a8f7c2b4344a4d73d93e8461844.jpg',
'https://m.atcdn.co.uk/a/media/a2c6dedf1d08469d9d95d802e215ca41.jpg',
'https://m.atcdn.co.uk/a/media/5e4bd530d26d44b6a4852f9305f39086.jpg',
'https://m.atcdn.co.uk/a/media/3f5e7e046e7843fda25af946eeb688af.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251166,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f8735aab3e074fff87cfc352575f49f9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243396,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6a7c04daeae424aae7a22829474ec50.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130589,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/28a038717c3543c59dd4e80625eaa659.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256212,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bfbee884f6104cb6ba7b2232253b50aa.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78455,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09a9783d5d6f4e6aafd4b41b57ffc4f3.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117552,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2ddcd38ab1f4741b4bdf68f660cddf5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257442,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e08d069a41e84e0699f5a8858cadcc25.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232883,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f49c9f995e747a385aabed15ef0b129.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166387,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/41df820207d9482586d1bb2f0a2aa129.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212833,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d9754a8f7c2b4344a4d73d93e8461844.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136657,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2c6dedf1d08469d9d95d802e215ca41.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178753,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e4bd530d26d44b6a4852f9305f39086.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9dcce9-73c3-5b0d-a1cc-b24936567518/1a9dcce9-73c3-5b0d-a1cc-b24936567518_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101934,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f5e7e046e7843fda25af946eeb688af.jpg',
'Width': 1600}],
'price': 4299,
'price_includes_vat': True,
'registration_date': '2009-03-01',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A5 2.0 TFSI Sport quattro Euro 4 2dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208020722%27 HTTP/1.1" 200 None
2025-12-05 12:57:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511208020722: {'created_time': 1764939465.506999, 'last_price_update_time': 1764939465.50701}
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511208020722') HTTP/1.1" 204 0
2025-12-05 12:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:57:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:57:46 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent runner,clean car, recently serviced,timing belt and '
'water pump replaced, comes with new mot,12 months AA '
'breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921771',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 175000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/77e7d937513b4a3cb4e55270dc723dca.jpg',
'https://m.atcdn.co.uk/a/media/54e7c98848db4df2b115f54362414d7e.jpg',
'https://m.atcdn.co.uk/a/media/3b4dbe5622f5463688e83cbf638834ae.jpg',
'https://m.atcdn.co.uk/a/media/a440238b7da54bd489457ad8c51d8070.jpg',
'https://m.atcdn.co.uk/a/media/68eb81a658054331b3a5f9b49fabfe08.jpg',
'https://m.atcdn.co.uk/a/media/c41a08ba96b046659452955fc29d0564.jpg',
'https://m.atcdn.co.uk/a/media/2c97780271f34a4581f3e50cb9a41c17.jpg',
'https://m.atcdn.co.uk/a/media/3511247f9dd54b0f8c8677e488d01d81.jpg',
'https://m.atcdn.co.uk/a/media/bcfffcf862e4436da47e30f7f2ed9b05.jpg',
'https://m.atcdn.co.uk/a/media/c42cdde457f745a9af584c4015bb0b60.jpg',
'https://m.atcdn.co.uk/a/media/56f1b88dc3ab4b2788efe014c58ef010.jpg',
'https://m.atcdn.co.uk/a/media/cf273d1d2e724563b1e3629b2e30da72.jpg'],
'price': 2299,
'price_includes_vat': True,
'registration_date': '2012-02-02',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Yeti 1.6 TDI GreenLine II Elegance Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2025-12-05 12:57:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c27ca37-8f18-5b6f-932b-37b6486e5e48 with identifier: 202511157921771
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 6c27ca37-8f18-5b6f-932b-37b6486e5e48
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77e7d937513b4a3cb4e55270dc723dca.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77e7d937513b4a3cb4e55270dc723dca.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54e7c98848db4df2b115f54362414d7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54e7c98848db4df2b115f54362414d7e.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b4dbe5622f5463688e83cbf638834ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b4dbe5622f5463688e83cbf638834ae.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa440238b7da54bd489457ad8c51d8070.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a440238b7da54bd489457ad8c51d8070.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68eb81a658054331b3a5f9b49fabfe08.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68eb81a658054331b3a5f9b49fabfe08.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc41a08ba96b046659452955fc29d0564.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c41a08ba96b046659452955fc29d0564.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c97780271f34a4581f3e50cb9a41c17.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c97780271f34a4581f3e50cb9a41c17.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3511247f9dd54b0f8c8677e488d01d81.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3511247f9dd54b0f8c8677e488d01d81.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbcfffcf862e4436da47e30f7f2ed9b05.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bcfffcf862e4436da47e30f7f2ed9b05.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc42cdde457f745a9af584c4015bb0b60.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c42cdde457f745a9af584c4015bb0b60.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F56f1b88dc3ab4b2788efe014c58ef010.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/56f1b88dc3ab4b2788efe014c58ef010.jpg already downloaded
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf273d1d2e724563b1e3629b2e30da72.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf273d1d2e724563b1e3629b2e30da72.jpg already downloaded
2025-12-05 12:57:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6c27ca37-8f18-5b6f-932b-37b6486e5e48 with identifier 202511157921771
2025-12-05 12:57:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:57:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6c27ca37-8f18-5b6f-932b-37b6486e5e48
2025-12-05 12:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent runner,clean car, recently serviced,timing belt and '
'water pump replaced, comes with new mot,12 months AA '
'breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Diesel',
'id': '6c27ca37-8f18-5b6f-932b-37b6486e5e48',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157921771',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 175000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/77e7d937513b4a3cb4e55270dc723dca.jpg',
'https://m.atcdn.co.uk/a/media/54e7c98848db4df2b115f54362414d7e.jpg',
'https://m.atcdn.co.uk/a/media/3b4dbe5622f5463688e83cbf638834ae.jpg',
'https://m.atcdn.co.uk/a/media/a440238b7da54bd489457ad8c51d8070.jpg',
'https://m.atcdn.co.uk/a/media/68eb81a658054331b3a5f9b49fabfe08.jpg',
'https://m.atcdn.co.uk/a/media/c41a08ba96b046659452955fc29d0564.jpg',
'https://m.atcdn.co.uk/a/media/2c97780271f34a4581f3e50cb9a41c17.jpg',
'https://m.atcdn.co.uk/a/media/3511247f9dd54b0f8c8677e488d01d81.jpg',
'https://m.atcdn.co.uk/a/media/bcfffcf862e4436da47e30f7f2ed9b05.jpg',
'https://m.atcdn.co.uk/a/media/c42cdde457f745a9af584c4015bb0b60.jpg',
'https://m.atcdn.co.uk/a/media/56f1b88dc3ab4b2788efe014c58ef010.jpg',
'https://m.atcdn.co.uk/a/media/cf273d1d2e724563b1e3629b2e30da72.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244659,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77e7d937513b4a3cb4e55270dc723dca.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280739,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/54e7c98848db4df2b115f54362414d7e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267915,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b4dbe5622f5463688e83cbf638834ae.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252404,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a440238b7da54bd489457ad8c51d8070.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271705,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/68eb81a658054331b3a5f9b49fabfe08.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249322,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c41a08ba96b046659452955fc29d0564.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185413,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c97780271f34a4581f3e50cb9a41c17.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195701,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3511247f9dd54b0f8c8677e488d01d81.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184356,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bcfffcf862e4436da47e30f7f2ed9b05.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212186,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c42cdde457f745a9af584c4015bb0b60.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154291,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/56f1b88dc3ab4b2788efe014c58ef010.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1876e70-6c2f-5aba-bde8-75581f30cbf6/b1876e70-6c2f-5aba-bde8-75581f30cbf6_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187317,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf273d1d2e724563b1e3629b2e30da72.jpg',
'Width': 1600}],
'price': 2299,
'price_includes_vat': True,
'registration_date': '2012-02-02',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Yeti 1.6 TDI GreenLine II Elegance Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157921771%27 HTTP/1.1" 200 None
2025-12-05 12:57:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157921771: {'created_time': 1764939466.653061, 'last_price_update_time': 1764939466.653071}
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157921771') HTTP/1.1" 204 0
2025-12-05 12:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:58:00 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 178,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent runner,1 owner, recently serviced,service '
'history,comes with 3 months warranty,12 months AA breakdown '
'cover,new mot,we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511238088216',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Range Rover Evoque',
'odometer': 54000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/579cde836c7b4c34a445c704f69d42b5.jpg',
'https://m.atcdn.co.uk/a/media/966922fa087240e0aac74dae8974b171.jpg',
'https://m.atcdn.co.uk/a/media/278c011e087c487cbbbad42de7f2ea4c.jpg',
'https://m.atcdn.co.uk/a/media/67fc6df38b484c46bc6b1cfa0eb1e57b.jpg',
'https://m.atcdn.co.uk/a/media/6304468baa9c4d779f00612a3471bec6.jpg',
'https://m.atcdn.co.uk/a/media/dd98875900b54802babb221924582e62.jpg',
'https://m.atcdn.co.uk/a/media/f763cb105b6e4e22a0b7b92ec5b2741f.jpg',
'https://m.atcdn.co.uk/a/media/54a17f4737c4442a80d318d99d8ffe0a.jpg',
'https://m.atcdn.co.uk/a/media/4520b8c52dff4dfd93f866c06ae475aa.jpg',
'https://m.atcdn.co.uk/a/media/105525b7a3a34772a60e42c913730089.jpg',
'https://m.atcdn.co.uk/a/media/fe9e7ba86166446eb3768fb4aaaae127.jpg',
'https://m.atcdn.co.uk/a/media/c6d2711139ac4e2793eb7809cc0d26d1.jpg',
'https://m.atcdn.co.uk/a/media/4fa6d6dd1bad478493053c2132d2a5a3.jpg'],
'price': 17999,
'price_includes_vat': True,
'registration_date': '2020-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque 2.0 D150 MHEV R-Dynamic Auto 4WD Euro '
'6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'R-Dynamic',
'year': 2020}
2025-12-05 12:58:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc85a08-62c1-5a66-8e37-bc8b4a969d30 with identifier: 202511238088216
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0cc85a08-62c1-5a66-8e37-bc8b4a969d30
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F579cde836c7b4c34a445c704f69d42b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/579cde836c7b4c34a445c704f69d42b5.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F966922fa087240e0aac74dae8974b171.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/966922fa087240e0aac74dae8974b171.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F278c011e087c487cbbbad42de7f2ea4c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/278c011e087c487cbbbad42de7f2ea4c.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F67fc6df38b484c46bc6b1cfa0eb1e57b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/67fc6df38b484c46bc6b1cfa0eb1e57b.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6304468baa9c4d779f00612a3471bec6.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6304468baa9c4d779f00612a3471bec6.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd98875900b54802babb221924582e62.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd98875900b54802babb221924582e62.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff763cb105b6e4e22a0b7b92ec5b2741f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f763cb105b6e4e22a0b7b92ec5b2741f.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54a17f4737c4442a80d318d99d8ffe0a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54a17f4737c4442a80d318d99d8ffe0a.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4520b8c52dff4dfd93f866c06ae475aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4520b8c52dff4dfd93f866c06ae475aa.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F105525b7a3a34772a60e42c913730089.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/105525b7a3a34772a60e42c913730089.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe9e7ba86166446eb3768fb4aaaae127.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe9e7ba86166446eb3768fb4aaaae127.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6d2711139ac4e2793eb7809cc0d26d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6d2711139ac4e2793eb7809cc0d26d1.jpg already downloaded
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fa6d6dd1bad478493053c2132d2a5a3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fa6d6dd1bad478493053c2132d2a5a3.jpg already downloaded
2025-12-05 12:58:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0cc85a08-62c1-5a66-8e37-bc8b4a969d30 with identifier 202511238088216
2025-12-05 12:58:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0cc85a08-62c1-5a66-8e37-bc8b4a969d30
2025-12-05 12:58:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 178,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent runner,1 owner, recently serviced,service '
'history,comes with 3 months warranty,12 months AA breakdown '
'cover,new mot,we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': '0cc85a08-62c1-5a66-8e37-bc8b4a969d30',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511238088216',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Range Rover Evoque',
'odometer': 54000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/579cde836c7b4c34a445c704f69d42b5.jpg',
'https://m.atcdn.co.uk/a/media/966922fa087240e0aac74dae8974b171.jpg',
'https://m.atcdn.co.uk/a/media/278c011e087c487cbbbad42de7f2ea4c.jpg',
'https://m.atcdn.co.uk/a/media/67fc6df38b484c46bc6b1cfa0eb1e57b.jpg',
'https://m.atcdn.co.uk/a/media/6304468baa9c4d779f00612a3471bec6.jpg',
'https://m.atcdn.co.uk/a/media/dd98875900b54802babb221924582e62.jpg',
'https://m.atcdn.co.uk/a/media/f763cb105b6e4e22a0b7b92ec5b2741f.jpg',
'https://m.atcdn.co.uk/a/media/54a17f4737c4442a80d318d99d8ffe0a.jpg',
'https://m.atcdn.co.uk/a/media/4520b8c52dff4dfd93f866c06ae475aa.jpg',
'https://m.atcdn.co.uk/a/media/105525b7a3a34772a60e42c913730089.jpg',
'https://m.atcdn.co.uk/a/media/fe9e7ba86166446eb3768fb4aaaae127.jpg',
'https://m.atcdn.co.uk/a/media/c6d2711139ac4e2793eb7809cc0d26d1.jpg',
'https://m.atcdn.co.uk/a/media/4fa6d6dd1bad478493053c2132d2a5a3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206926,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/579cde836c7b4c34a445c704f69d42b5.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218719,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/966922fa087240e0aac74dae8974b171.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219867,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/278c011e087c487cbbbad42de7f2ea4c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217147,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/67fc6df38b484c46bc6b1cfa0eb1e57b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201813,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6304468baa9c4d779f00612a3471bec6.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192398,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dd98875900b54802babb221924582e62.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228858,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f763cb105b6e4e22a0b7b92ec5b2741f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151142,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/54a17f4737c4442a80d318d99d8ffe0a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117002,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4520b8c52dff4dfd93f866c06ae475aa.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150479,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/105525b7a3a34772a60e42c913730089.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166334,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe9e7ba86166446eb3768fb4aaaae127.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159426,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6d2711139ac4e2793eb7809cc0d26d1.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b60b41db-4ba4-5fcf-b1fc-f1a2557bd113/b60b41db-4ba4-5fcf-b1fc-f1a2557bd113_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141517,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fa6d6dd1bad478493053c2132d2a5a3.jpg',
'Width': 1600}],
'price': 17999,
'price_includes_vat': True,
'registration_date': '2020-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque 2.0 D150 MHEV R-Dynamic Auto 4WD Euro '
'6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'R-Dynamic',
'year': 2020}
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511238088216%27 HTTP/1.1" 200 None
2025-12-05 12:58:00 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511238088216: {'created_time': 1764939480.839981, 'last_price_update_time': 1764939480.839988}
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511238088216') HTTP/1.1" 204 0
2025-12-05 12:58:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.234(s), this was the 1st time calling it.
2025-12-05 12:58:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6530889216945974 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 12:58:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 12:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:58:19 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 224,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent runner, recently serviced,service history,new mot,2 '
'months warranty,12 months AA breakdown cover,panoramic roof,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 147,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305568',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'RAV4',
'odometer': 96400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/76961a702eeb4bf482b288131c742155.jpg',
'https://m.atcdn.co.uk/a/media/6db82c7b00d549c29e59be78eb67f498.jpg',
'https://m.atcdn.co.uk/a/media/84b40f9096874d14989dc8e13a409941.jpg',
'https://m.atcdn.co.uk/a/media/6abbd41ed6cf42468bfe61a8dc5256af.jpg',
'https://m.atcdn.co.uk/a/media/5b33bcf1c6834260adc22e9d08acfac0.jpg',
'https://m.atcdn.co.uk/a/media/b1fa04f201ee4800ade368ff20fa765d.jpg',
'https://m.atcdn.co.uk/a/media/00b9cb6475f642cb93ed2698c5b2e40b.jpg',
'https://m.atcdn.co.uk/a/media/36017c7e5a4e4a3e8da6e89e2df29da7.jpg',
'https://m.atcdn.co.uk/a/media/72387f70c0364f46b500f7258d55bb2d.jpg',
'https://m.atcdn.co.uk/a/media/3c3f8d7fd92e4141b0c4dfeac54af1e8.jpg',
'https://m.atcdn.co.uk/a/media/c5e938d59ea54b0389ba7aba488e6981.jpg',
'https://m.atcdn.co.uk/a/media/b6ad90d3c3184c48bf111047d5536e88.jpg'],
'price': 3299,
'price_includes_vat': True,
'registration_date': '2004-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV4 2.0 VVT-i XT4 4WD 5dr',
'transmission': 'automatic',
'trim': 'XT4',
'year': 2004}
2025-12-05 12:58:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 12ef6bb1-a875-5ced-a43c-f17289fc11c4 with identifier: 202512028305568
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 12ef6bb1-a875-5ced-a43c-f17289fc11c4
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76961a702eeb4bf482b288131c742155.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76961a702eeb4bf482b288131c742155.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6db82c7b00d549c29e59be78eb67f498.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6db82c7b00d549c29e59be78eb67f498.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84b40f9096874d14989dc8e13a409941.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84b40f9096874d14989dc8e13a409941.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6abbd41ed6cf42468bfe61a8dc5256af.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6abbd41ed6cf42468bfe61a8dc5256af.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b33bcf1c6834260adc22e9d08acfac0.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b33bcf1c6834260adc22e9d08acfac0.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb1fa04f201ee4800ade368ff20fa765d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b1fa04f201ee4800ade368ff20fa765d.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00b9cb6475f642cb93ed2698c5b2e40b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00b9cb6475f642cb93ed2698c5b2e40b.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36017c7e5a4e4a3e8da6e89e2df29da7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36017c7e5a4e4a3e8da6e89e2df29da7.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F72387f70c0364f46b500f7258d55bb2d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/72387f70c0364f46b500f7258d55bb2d.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3c3f8d7fd92e4141b0c4dfeac54af1e8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3c3f8d7fd92e4141b0c4dfeac54af1e8.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5e938d59ea54b0389ba7aba488e6981.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5e938d59ea54b0389ba7aba488e6981.jpg already downloaded
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb6ad90d3c3184c48bf111047d5536e88.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b6ad90d3c3184c48bf111047d5536e88.jpg already downloaded
2025-12-05 12:58:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 12ef6bb1-a875-5ced-a43c-f17289fc11c4 with identifier 202512028305568
2025-12-05 12:58:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 12ef6bb1-a875-5ced-a43c-f17289fc11c4
2025-12-05 12:58:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 224,
'color': 'Blue',
'currency': 'GBP',
'description': 'Excellent runner, recently serviced,service history,new mot,2 '
'months warranty,12 months AA breakdown cover,panoramic roof,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 147,
'fuel_type': 'Petrol',
'id': '12ef6bb1-a875-5ced-a43c-f17289fc11c4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028305568',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Toyota',
'model': 'RAV4',
'odometer': 96400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/76961a702eeb4bf482b288131c742155.jpg',
'https://m.atcdn.co.uk/a/media/6db82c7b00d549c29e59be78eb67f498.jpg',
'https://m.atcdn.co.uk/a/media/84b40f9096874d14989dc8e13a409941.jpg',
'https://m.atcdn.co.uk/a/media/6abbd41ed6cf42468bfe61a8dc5256af.jpg',
'https://m.atcdn.co.uk/a/media/5b33bcf1c6834260adc22e9d08acfac0.jpg',
'https://m.atcdn.co.uk/a/media/b1fa04f201ee4800ade368ff20fa765d.jpg',
'https://m.atcdn.co.uk/a/media/00b9cb6475f642cb93ed2698c5b2e40b.jpg',
'https://m.atcdn.co.uk/a/media/36017c7e5a4e4a3e8da6e89e2df29da7.jpg',
'https://m.atcdn.co.uk/a/media/72387f70c0364f46b500f7258d55bb2d.jpg',
'https://m.atcdn.co.uk/a/media/3c3f8d7fd92e4141b0c4dfeac54af1e8.jpg',
'https://m.atcdn.co.uk/a/media/c5e938d59ea54b0389ba7aba488e6981.jpg',
'https://m.atcdn.co.uk/a/media/b6ad90d3c3184c48bf111047d5536e88.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224867,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/76961a702eeb4bf482b288131c742155.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239497,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6db82c7b00d549c29e59be78eb67f498.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303732,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/84b40f9096874d14989dc8e13a409941.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280736,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6abbd41ed6cf42468bfe61a8dc5256af.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253609,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5b33bcf1c6834260adc22e9d08acfac0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292191,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b1fa04f201ee4800ade368ff20fa765d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239936,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/00b9cb6475f642cb93ed2698c5b2e40b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201256,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/36017c7e5a4e4a3e8da6e89e2df29da7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94407,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/72387f70c0364f46b500f7258d55bb2d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202954,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3c3f8d7fd92e4141b0c4dfeac54af1e8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235070,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5e938d59ea54b0389ba7aba488e6981.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f253cc2-f20c-5afd-8da9-023adcc18a8b/6f253cc2-f20c-5afd-8da9-023adcc18a8b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202735,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b6ad90d3c3184c48bf111047d5536e88.jpg',
'Width': 1600}],
'price': 3299,
'price_includes_vat': True,
'registration_date': '2004-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV4 2.0 VVT-i XT4 4WD 5dr',
'transmission': 'automatic',
'trim': 'XT4',
'year': 2004}
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028305568%27 HTTP/1.1" 200 None
2025-12-05 12:58:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512028305568: {'created_time': 1764939499.958832, 'last_price_update_time': 1764939499.958843}
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512028305568') HTTP/1.1" 204 0
2025-12-05 12:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:58:27 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 168,
'color': 'White',
'currency': 'GBP',
'description': 'This 2014 Ford Transit Custom 2.2 TDCi 310 Kombi L2 H1 5dr '
'offers a blend of practicality and comfort, making it a '
'reliable choice for various needs. Equipped with a robust '
'2.2 litre diesel engine, this model comes with useful '
'features such as rear mud flaps, a fixed rear window, and the '
'convenience of Ice Pack 1 and Ice Pack 2. For added safety, '
'it includes an airbag for the passenger.\n'
'\n'
'With an impressive fuel economy of 44 miles per gallon, this '
'Transit Custom stands out for its efficiency compared to '
'similar vehicles. Furthermore, its low CO2 emissions '
'contribute to a more environmentally conscious driving '
'experience. This combination of economical running costs and '
'thoughtful features makes it a compelling option.comes with 3 '
'months warranty,12 months AA breakdown cover, new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 123,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258137869',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 132000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e00455e0b2e04c0aae10a3c27c4d8f51.jpg',
'https://m.atcdn.co.uk/a/media/9691ba4e88dd422992d2927c08bc00b4.jpg',
'https://m.atcdn.co.uk/a/media/85a0d1ab30d7495381e5840c530df162.jpg',
'https://m.atcdn.co.uk/a/media/316a582cf344459087dfb17a33ca0937.jpg',
'https://m.atcdn.co.uk/a/media/59ab6e394bb747a9b5456166f1e51da1.jpg',
'https://m.atcdn.co.uk/a/media/b32aa462f4e445afbbd717cf2167f973.jpg',
'https://m.atcdn.co.uk/a/media/d750f40adc6a4933851ad1e3e4193805.jpg',
'https://m.atcdn.co.uk/a/media/de63bc66d3204f069f99f66ba35142cb.jpg',
'https://m.atcdn.co.uk/a/media/22b92fa9e0cb45c49114a212cd7cbbef.jpg',
'https://m.atcdn.co.uk/a/media/a71351ade81d4da8b88bf8fd659ed402.jpg',
'https://m.atcdn.co.uk/a/media/3ec2e17b7a0947eba3abec48e148dab2.jpg',
'https://m.atcdn.co.uk/a/media/dcbb93b0a3b344efa921d7df974ea78b.jpg',
'https://m.atcdn.co.uk/a/media/62a5abe716cf4313916d10d2c5509cc0.jpg',
'https://m.atcdn.co.uk/a/media/c4d71dd8e8384b4aac7537f394a3e934.jpg',
'https://m.atcdn.co.uk/a/media/a94255b71dda481a862d198a490a60a9.jpg',
'https://m.atcdn.co.uk/a/media/0720f5e584c54614a2c6994d70502085.jpg'],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2014-10-09',
'seats_number': 9,
'seller_name': None,
'title': 'Ford Transit Custom 2.2 TDCi 310 Kombi L2 H1 5dr',
'transmission': 'manual',
'year': 2014}
2025-12-05 12:58:27 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6202142f-a956-5cc7-ade6-38202928a05c with identifier: 202511258137869
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6202142f-a956-5cc7-ade6-38202928a05c
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe00455e0b2e04c0aae10a3c27c4d8f51.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e00455e0b2e04c0aae10a3c27c4d8f51.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9691ba4e88dd422992d2927c08bc00b4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9691ba4e88dd422992d2927c08bc00b4.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85a0d1ab30d7495381e5840c530df162.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85a0d1ab30d7495381e5840c530df162.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F316a582cf344459087dfb17a33ca0937.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/316a582cf344459087dfb17a33ca0937.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59ab6e394bb747a9b5456166f1e51da1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59ab6e394bb747a9b5456166f1e51da1.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb32aa462f4e445afbbd717cf2167f973.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b32aa462f4e445afbbd717cf2167f973.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd750f40adc6a4933851ad1e3e4193805.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d750f40adc6a4933851ad1e3e4193805.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde63bc66d3204f069f99f66ba35142cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de63bc66d3204f069f99f66ba35142cb.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F22b92fa9e0cb45c49114a212cd7cbbef.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/22b92fa9e0cb45c49114a212cd7cbbef.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa71351ade81d4da8b88bf8fd659ed402.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a71351ade81d4da8b88bf8fd659ed402.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ec2e17b7a0947eba3abec48e148dab2.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ec2e17b7a0947eba3abec48e148dab2.jpg already downloaded
2025-12-05 12:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdcbb93b0a3b344efa921d7df974ea78b.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dcbb93b0a3b344efa921d7df974ea78b.jpg already downloaded
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62a5abe716cf4313916d10d2c5509cc0.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62a5abe716cf4313916d10d2c5509cc0.jpg already downloaded
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4d71dd8e8384b4aac7537f394a3e934.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4d71dd8e8384b4aac7537f394a3e934.jpg already downloaded
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa94255b71dda481a862d198a490a60a9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a94255b71dda481a862d198a490a60a9.jpg already downloaded
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0720f5e584c54614a2c6994d70502085.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0720f5e584c54614a2c6994d70502085.jpg already downloaded
2025-12-05 12:58:28 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6202142f-a956-5cc7-ade6-38202928a05c with identifier 202511258137869
2025-12-05 12:58:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:28 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6202142f-a956-5cc7-ade6-38202928a05c
2025-12-05 12:58:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 168,
'color': 'White',
'currency': 'GBP',
'description': 'This 2014 Ford Transit Custom 2.2 TDCi 310 Kombi L2 H1 5dr '
'offers a blend of practicality and comfort, making it a '
'reliable choice for various needs. Equipped with a robust '
'2.2 litre diesel engine, this model comes with useful '
'features such as rear mud flaps, a fixed rear window, and the '
'convenience of Ice Pack 1 and Ice Pack 2. For added safety, '
'it includes an airbag for the passenger.\n'
'\n'
'With an impressive fuel economy of 44 miles per gallon, this '
'Transit Custom stands out for its efficiency compared to '
'similar vehicles. Furthermore, its low CO2 emissions '
'contribute to a more environmentally conscious driving '
'experience. This combination of economical running costs and '
'thoughtful features makes it a compelling option.comes with 3 '
'months warranty,12 months AA breakdown cover, new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 123,
'fuel_type': 'Diesel',
'id': '6202142f-a956-5cc7-ade6-38202928a05c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258137869',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 132000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e00455e0b2e04c0aae10a3c27c4d8f51.jpg',
'https://m.atcdn.co.uk/a/media/9691ba4e88dd422992d2927c08bc00b4.jpg',
'https://m.atcdn.co.uk/a/media/85a0d1ab30d7495381e5840c530df162.jpg',
'https://m.atcdn.co.uk/a/media/316a582cf344459087dfb17a33ca0937.jpg',
'https://m.atcdn.co.uk/a/media/59ab6e394bb747a9b5456166f1e51da1.jpg',
'https://m.atcdn.co.uk/a/media/b32aa462f4e445afbbd717cf2167f973.jpg',
'https://m.atcdn.co.uk/a/media/d750f40adc6a4933851ad1e3e4193805.jpg',
'https://m.atcdn.co.uk/a/media/de63bc66d3204f069f99f66ba35142cb.jpg',
'https://m.atcdn.co.uk/a/media/22b92fa9e0cb45c49114a212cd7cbbef.jpg',
'https://m.atcdn.co.uk/a/media/a71351ade81d4da8b88bf8fd659ed402.jpg',
'https://m.atcdn.co.uk/a/media/3ec2e17b7a0947eba3abec48e148dab2.jpg',
'https://m.atcdn.co.uk/a/media/dcbb93b0a3b344efa921d7df974ea78b.jpg',
'https://m.atcdn.co.uk/a/media/62a5abe716cf4313916d10d2c5509cc0.jpg',
'https://m.atcdn.co.uk/a/media/c4d71dd8e8384b4aac7537f394a3e934.jpg',
'https://m.atcdn.co.uk/a/media/a94255b71dda481a862d198a490a60a9.jpg',
'https://m.atcdn.co.uk/a/media/0720f5e584c54614a2c6994d70502085.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335915,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e00455e0b2e04c0aae10a3c27c4d8f51.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355784,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9691ba4e88dd422992d2927c08bc00b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421825,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85a0d1ab30d7495381e5840c530df162.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402421,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/316a582cf344459087dfb17a33ca0937.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426558,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59ab6e394bb747a9b5456166f1e51da1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357418,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b32aa462f4e445afbbd717cf2167f973.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361781,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d750f40adc6a4933851ad1e3e4193805.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336052,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/de63bc66d3204f069f99f66ba35142cb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357606,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/22b92fa9e0cb45c49114a212cd7cbbef.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332021,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a71351ade81d4da8b88bf8fd659ed402.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251059,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ec2e17b7a0947eba3abec48e148dab2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307335,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dcbb93b0a3b344efa921d7df974ea78b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312215,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62a5abe716cf4313916d10d2c5509cc0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430122,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4d71dd8e8384b4aac7537f394a3e934.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368628,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a94255b71dda481a862d198a490a60a9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb3a49bd-104f-59f8-b7a1-79d3db89d46f/cb3a49bd-104f-59f8-b7a1-79d3db89d46f_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326812,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0720f5e584c54614a2c6994d70502085.jpg',
'Width': 2048}],
'price': 5999,
'price_includes_vat': True,
'registration_date': '2014-10-09',
'seats_number': 9,
'seller_name': None,
'title': 'Ford Transit Custom 2.2 TDCi 310 Kombi L2 H1 5dr',
'transmission': 'manual',
'year': 2014}
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258137869%27 HTTP/1.1" 200 None
2025-12-05 12:58:28 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258137869: {'created_time': 1764939508.095669, 'last_price_update_time': 1764939508.095679}
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258137869') HTTP/1.1" 204 0
2025-12-05 12:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:58:29 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 179,
'color': 'Grey',
'currency': 'GBP',
'description': 'Part exchange clearance, clean automatic car, recently '
'serviced,service history,comes with 1 month warranty,12 '
'months AA breakdown cover, new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 158,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138611',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Insignia',
'odometer': 187000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b6fbedfdc22346b69d7ed2e6d0e41071.jpg',
'https://m.atcdn.co.uk/a/media/ea224acf77114f8694364f331a3e978f.jpg',
'https://m.atcdn.co.uk/a/media/081e8b2e4ab144e48e4c021db1a06db0.jpg',
'https://m.atcdn.co.uk/a/media/a1ae273fb254466dabc20161de694d65.jpg',
'https://m.atcdn.co.uk/a/media/351fe7d85c484961a53b534d78e20a50.jpg',
'https://m.atcdn.co.uk/a/media/d4308361236d4670a242f29bb8ae1d35.jpg',
'https://m.atcdn.co.uk/a/media/315bb94068c84247812237598528b225.jpg',
'https://m.atcdn.co.uk/a/media/c15ac08dca0b4d1fb0298104ff38fe32.jpg',
'https://m.atcdn.co.uk/a/media/8f064339571f4866898068bd05eaddb2.jpg',
'https://m.atcdn.co.uk/a/media/ef921e9c811940a9be85064ac1a1d4da.jpg',
'https://m.atcdn.co.uk/a/media/a217daeb6ee942d99d10b1d36d3819d9.jpg',
'https://m.atcdn.co.uk/a/media/5d61998fa32042b98d33a7baf2efe4eb.jpg'],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2009-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Insignia 2.0 CDTi Elite Nav Auto Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Elite Nav',
'year': 2009}
2025-12-05 12:58:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fcdb34d-cec9-588e-8494-2576c75cd932 with identifier: 202511258138611
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 8fcdb34d-cec9-588e-8494-2576c75cd932
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb6fbedfdc22346b69d7ed2e6d0e41071.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b6fbedfdc22346b69d7ed2e6d0e41071.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea224acf77114f8694364f331a3e978f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea224acf77114f8694364f331a3e978f.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F081e8b2e4ab144e48e4c021db1a06db0.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/081e8b2e4ab144e48e4c021db1a06db0.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa1ae273fb254466dabc20161de694d65.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a1ae273fb254466dabc20161de694d65.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F351fe7d85c484961a53b534d78e20a50.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/351fe7d85c484961a53b534d78e20a50.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4308361236d4670a242f29bb8ae1d35.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4308361236d4670a242f29bb8ae1d35.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F315bb94068c84247812237598528b225.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/315bb94068c84247812237598528b225.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc15ac08dca0b4d1fb0298104ff38fe32.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c15ac08dca0b4d1fb0298104ff38fe32.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f064339571f4866898068bd05eaddb2.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f064339571f4866898068bd05eaddb2.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef921e9c811940a9be85064ac1a1d4da.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef921e9c811940a9be85064ac1a1d4da.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa217daeb6ee942d99d10b1d36d3819d9.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a217daeb6ee942d99d10b1d36d3819d9.jpg already downloaded
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5d61998fa32042b98d33a7baf2efe4eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5d61998fa32042b98d33a7baf2efe4eb.jpg already downloaded
2025-12-05 12:58:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8fcdb34d-cec9-588e-8494-2576c75cd932 with identifier 202511258138611
2025-12-05 12:58:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8fcdb34d-cec9-588e-8494-2576c75cd932
2025-12-05 12:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 179,
'color': 'Grey',
'currency': 'GBP',
'description': 'Part exchange clearance, clean automatic car, recently '
'serviced,service history,comes with 1 month warranty,12 '
'months AA breakdown cover, new mot',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 158,
'fuel_type': 'Diesel',
'id': '8fcdb34d-cec9-588e-8494-2576c75cd932',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138611',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Vauxhall',
'model': 'Insignia',
'odometer': 187000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b6fbedfdc22346b69d7ed2e6d0e41071.jpg',
'https://m.atcdn.co.uk/a/media/ea224acf77114f8694364f331a3e978f.jpg',
'https://m.atcdn.co.uk/a/media/081e8b2e4ab144e48e4c021db1a06db0.jpg',
'https://m.atcdn.co.uk/a/media/a1ae273fb254466dabc20161de694d65.jpg',
'https://m.atcdn.co.uk/a/media/351fe7d85c484961a53b534d78e20a50.jpg',
'https://m.atcdn.co.uk/a/media/d4308361236d4670a242f29bb8ae1d35.jpg',
'https://m.atcdn.co.uk/a/media/315bb94068c84247812237598528b225.jpg',
'https://m.atcdn.co.uk/a/media/c15ac08dca0b4d1fb0298104ff38fe32.jpg',
'https://m.atcdn.co.uk/a/media/8f064339571f4866898068bd05eaddb2.jpg',
'https://m.atcdn.co.uk/a/media/ef921e9c811940a9be85064ac1a1d4da.jpg',
'https://m.atcdn.co.uk/a/media/a217daeb6ee942d99d10b1d36d3819d9.jpg',
'https://m.atcdn.co.uk/a/media/5d61998fa32042b98d33a7baf2efe4eb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239867,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b6fbedfdc22346b69d7ed2e6d0e41071.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311202,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea224acf77114f8694364f331a3e978f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273936,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/081e8b2e4ab144e48e4c021db1a06db0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299124,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a1ae273fb254466dabc20161de694d65.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266809,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/351fe7d85c484961a53b534d78e20a50.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229363,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d4308361236d4670a242f29bb8ae1d35.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207549,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/315bb94068c84247812237598528b225.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128850,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c15ac08dca0b4d1fb0298104ff38fe32.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180563,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f064339571f4866898068bd05eaddb2.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168504,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef921e9c811940a9be85064ac1a1d4da.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189271,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a217daeb6ee942d99d10b1d36d3819d9.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24351bb4-17b1-55da-8c26-49015df9f9b3/24351bb4-17b1-55da-8c26-49015df9f9b3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265446,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5d61998fa32042b98d33a7baf2efe4eb.jpg',
'Width': 1600}],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2009-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Insignia 2.0 CDTi Elite Nav Auto Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Elite Nav',
'year': 2009}
2025-12-05 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138611%27 HTTP/1.1" 200 None
2025-12-05 12:58:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258138611: {'created_time': 1764939510.412442, 'last_price_update_time': 1764939510.41245}
2025-12-05 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258138611') HTTP/1.1" 204 0
2025-12-05 12:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:58:31 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'White',
'currency': 'GBP',
'description': 'Clean automatic car, excellent runner,top version,2 keys, '
'recently serviced,service history ,comes with 3 months '
'warranty,new mot,12 months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138675',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Hyundai',
'model': 'i30',
'odometer': 141000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3842b4c40c92462881ff42b69712ff8e.jpg',
'https://m.atcdn.co.uk/a/media/d21df6688e134fb88bedaa954b0f9870.jpg',
'https://m.atcdn.co.uk/a/media/120d02a2144845d8b1425a01a9471de3.jpg',
'https://m.atcdn.co.uk/a/media/1808e3a7f66545b6bde97c3b63654e45.jpg',
'https://m.atcdn.co.uk/a/media/fa6c9f3f4cca4dae84f3d6ee525c6c17.jpg',
'https://m.atcdn.co.uk/a/media/2918ddaa63bc4cae8ee2e00997d650b0.jpg',
'https://m.atcdn.co.uk/a/media/16c9ebae73c945b3883e09d2a6b8046a.jpg',
'https://m.atcdn.co.uk/a/media/923ad07d5707400b8d2052c642d0250d.jpg',
'https://m.atcdn.co.uk/a/media/59921f6bcc6e4ffcb919ebbbea883145.jpg',
'https://m.atcdn.co.uk/a/media/f7b1775dc28a4576b2d755182d759051.jpg',
'https://m.atcdn.co.uk/a/media/290cd5af4dae4d28972c71c67d7e9fca.jpg',
'https://m.atcdn.co.uk/a/media/c331fcd2929048a8b8c74299ce335efd.jpg'],
'price': 5299,
'price_includes_vat': True,
'registration_date': '2018-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i30 1.4 T-GDi Blue Drive SE Nav DCT Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE Nav',
'year': 2018}
2025-12-05 12:58:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: eae88c25-96bd-50c3-99ea-f44083f82187 with identifier: 202511258138675
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item eae88c25-96bd-50c3-99ea-f44083f82187
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3842b4c40c92462881ff42b69712ff8e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3842b4c40c92462881ff42b69712ff8e.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd21df6688e134fb88bedaa954b0f9870.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d21df6688e134fb88bedaa954b0f9870.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F120d02a2144845d8b1425a01a9471de3.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/120d02a2144845d8b1425a01a9471de3.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1808e3a7f66545b6bde97c3b63654e45.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1808e3a7f66545b6bde97c3b63654e45.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa6c9f3f4cca4dae84f3d6ee525c6c17.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa6c9f3f4cca4dae84f3d6ee525c6c17.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2918ddaa63bc4cae8ee2e00997d650b0.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2918ddaa63bc4cae8ee2e00997d650b0.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16c9ebae73c945b3883e09d2a6b8046a.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16c9ebae73c945b3883e09d2a6b8046a.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F923ad07d5707400b8d2052c642d0250d.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/923ad07d5707400b8d2052c642d0250d.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59921f6bcc6e4ffcb919ebbbea883145.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59921f6bcc6e4ffcb919ebbbea883145.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff7b1775dc28a4576b2d755182d759051.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f7b1775dc28a4576b2d755182d759051.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F290cd5af4dae4d28972c71c67d7e9fca.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/290cd5af4dae4d28972c71c67d7e9fca.jpg already downloaded
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc331fcd2929048a8b8c74299ce335efd.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c331fcd2929048a8b8c74299ce335efd.jpg already downloaded
2025-12-05 12:58:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: eae88c25-96bd-50c3-99ea-f44083f82187 with identifier 202511258138675
2025-12-05 12:58:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item eae88c25-96bd-50c3-99ea-f44083f82187
2025-12-05 12:58:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'White',
'currency': 'GBP',
'description': 'Clean automatic car, excellent runner,top version,2 keys, '
'recently serviced,service history ,comes with 3 months '
'warranty,new mot,12 months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': 'eae88c25-96bd-50c3-99ea-f44083f82187',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138675',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Hyundai',
'model': 'i30',
'odometer': 141000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3842b4c40c92462881ff42b69712ff8e.jpg',
'https://m.atcdn.co.uk/a/media/d21df6688e134fb88bedaa954b0f9870.jpg',
'https://m.atcdn.co.uk/a/media/120d02a2144845d8b1425a01a9471de3.jpg',
'https://m.atcdn.co.uk/a/media/1808e3a7f66545b6bde97c3b63654e45.jpg',
'https://m.atcdn.co.uk/a/media/fa6c9f3f4cca4dae84f3d6ee525c6c17.jpg',
'https://m.atcdn.co.uk/a/media/2918ddaa63bc4cae8ee2e00997d650b0.jpg',
'https://m.atcdn.co.uk/a/media/16c9ebae73c945b3883e09d2a6b8046a.jpg',
'https://m.atcdn.co.uk/a/media/923ad07d5707400b8d2052c642d0250d.jpg',
'https://m.atcdn.co.uk/a/media/59921f6bcc6e4ffcb919ebbbea883145.jpg',
'https://m.atcdn.co.uk/a/media/f7b1775dc28a4576b2d755182d759051.jpg',
'https://m.atcdn.co.uk/a/media/290cd5af4dae4d28972c71c67d7e9fca.jpg',
'https://m.atcdn.co.uk/a/media/c331fcd2929048a8b8c74299ce335efd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204786,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3842b4c40c92462881ff42b69712ff8e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237369,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d21df6688e134fb88bedaa954b0f9870.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259669,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/120d02a2144845d8b1425a01a9471de3.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232789,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1808e3a7f66545b6bde97c3b63654e45.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230374,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa6c9f3f4cca4dae84f3d6ee525c6c17.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230694,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2918ddaa63bc4cae8ee2e00997d650b0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199481,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/16c9ebae73c945b3883e09d2a6b8046a.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189990,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/923ad07d5707400b8d2052c642d0250d.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172581,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59921f6bcc6e4ffcb919ebbbea883145.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171235,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f7b1775dc28a4576b2d755182d759051.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135905,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/290cd5af4dae4d28972c71c67d7e9fca.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b719cc-dd72-5a5f-830f-895c9817fb9f/d3b719cc-dd72-5a5f-830f-895c9817fb9f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148135,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c331fcd2929048a8b8c74299ce335efd.jpg',
'Width': 1600}],
'price': 5299,
'price_includes_vat': True,
'registration_date': '2018-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i30 1.4 T-GDi Blue Drive SE Nav DCT Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE Nav',
'year': 2018}
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138675%27 HTTP/1.1" 200 None
2025-12-05 12:58:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258138675: {'created_time': 1764939511.380395, 'last_price_update_time': 1764939511.380405}
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258138675') HTTP/1.1" 204 0
2025-12-05 12:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:32 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 194,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent condition, top version,recently serviced, service '
'history, clean car, 2 keys, comes with new mot, 3 months '
'warranty, 12 months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2.2L',
'engine_horse_power': 158,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138891',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Freelander 2',
'odometer': 100279,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/dff31505ac164ead984df7e953658a47.jpg',
'https://m.atcdn.co.uk/a/media/47e2299ed7ee46bd9f610cf265b52c53.jpg',
'https://m.atcdn.co.uk/a/media/ec5e3f79bd0749fdbd589b950fba1511.jpg',
'https://m.atcdn.co.uk/a/media/3d7ae4d61b38474b9ee29d29f1e2bffb.jpg',
'https://m.atcdn.co.uk/a/media/c3b8befeaeef4cdcbc9d160e4d6502cd.jpg',
'https://m.atcdn.co.uk/a/media/f581e951cf9b495f9a1aecf8380e8ed2.jpg',
'https://m.atcdn.co.uk/a/media/20d3b35cb27a4510b9e1a8c7b02cddd8.jpg',
'https://m.atcdn.co.uk/a/media/eff458d6406247c58c33607e7f78ccbb.jpg',
'https://m.atcdn.co.uk/a/media/53557776a8f5450583e4c438aeeb9594.jpg',
'https://m.atcdn.co.uk/a/media/0a58fc94c26a4338b249638600a9ddc8.jpg',
'https://m.atcdn.co.uk/a/media/0acc19107a2d4e619e95e3c63971dfb0.jpg',
'https://m.atcdn.co.uk/a/media/b80376d7b09f41c48d3fc20a2fae2557.jpg'],
'price': 2999,
'price_includes_vat': True,
'registration_date': '2009-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Freelander 2 2.2 TD4 GS 4WD Euro 4 5dr',
'transmission': 'manual',
'trim': 'GS',
'year': 2009}
2025-12-05 12:58:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dc10fbc2-7cf3-5f2c-bf3d-2113306f790d with identifier: 202511258138891
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item dc10fbc2-7cf3-5f2c-bf3d-2113306f790d
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdff31505ac164ead984df7e953658a47.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dff31505ac164ead984df7e953658a47.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47e2299ed7ee46bd9f610cf265b52c53.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47e2299ed7ee46bd9f610cf265b52c53.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec5e3f79bd0749fdbd589b950fba1511.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec5e3f79bd0749fdbd589b950fba1511.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3d7ae4d61b38474b9ee29d29f1e2bffb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3d7ae4d61b38474b9ee29d29f1e2bffb.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3b8befeaeef4cdcbc9d160e4d6502cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3b8befeaeef4cdcbc9d160e4d6502cd.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff581e951cf9b495f9a1aecf8380e8ed2.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f581e951cf9b495f9a1aecf8380e8ed2.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20d3b35cb27a4510b9e1a8c7b02cddd8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20d3b35cb27a4510b9e1a8c7b02cddd8.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feff458d6406247c58c33607e7f78ccbb.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eff458d6406247c58c33607e7f78ccbb.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53557776a8f5450583e4c438aeeb9594.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53557776a8f5450583e4c438aeeb9594.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a58fc94c26a4338b249638600a9ddc8.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a58fc94c26a4338b249638600a9ddc8.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0acc19107a2d4e619e95e3c63971dfb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0acc19107a2d4e619e95e3c63971dfb0.jpg already downloaded
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb80376d7b09f41c48d3fc20a2fae2557.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b80376d7b09f41c48d3fc20a2fae2557.jpg already downloaded
2025-12-05 12:58:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dc10fbc2-7cf3-5f2c-bf3d-2113306f790d with identifier 202511258138891
2025-12-05 12:58:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dc10fbc2-7cf3-5f2c-bf3d-2113306f790d
2025-12-05 12:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 194,
'color': 'Black',
'currency': 'GBP',
'description': 'Excellent condition, top version,recently serviced, service '
'history, clean car, 2 keys, comes with new mot, 3 months '
'warranty, 12 months AA breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2.2L',
'engine_horse_power': 158,
'fuel_type': 'Diesel',
'id': 'dc10fbc2-7cf3-5f2c-bf3d-2113306f790d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258138891',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Land Rover',
'model': 'Freelander 2',
'odometer': 100279,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photo_urls': ['https://m.atcdn.co.uk/a/media/dff31505ac164ead984df7e953658a47.jpg',
'https://m.atcdn.co.uk/a/media/47e2299ed7ee46bd9f610cf265b52c53.jpg',
'https://m.atcdn.co.uk/a/media/ec5e3f79bd0749fdbd589b950fba1511.jpg',
'https://m.atcdn.co.uk/a/media/3d7ae4d61b38474b9ee29d29f1e2bffb.jpg',
'https://m.atcdn.co.uk/a/media/c3b8befeaeef4cdcbc9d160e4d6502cd.jpg',
'https://m.atcdn.co.uk/a/media/f581e951cf9b495f9a1aecf8380e8ed2.jpg',
'https://m.atcdn.co.uk/a/media/20d3b35cb27a4510b9e1a8c7b02cddd8.jpg',
'https://m.atcdn.co.uk/a/media/eff458d6406247c58c33607e7f78ccbb.jpg',
'https://m.atcdn.co.uk/a/media/53557776a8f5450583e4c438aeeb9594.jpg',
'https://m.atcdn.co.uk/a/media/0a58fc94c26a4338b249638600a9ddc8.jpg',
'https://m.atcdn.co.uk/a/media/0acc19107a2d4e619e95e3c63971dfb0.jpg',
'https://m.atcdn.co.uk/a/media/b80376d7b09f41c48d3fc20a2fae2557.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242792,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dff31505ac164ead984df7e953658a47.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323062,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/47e2299ed7ee46bd9f610cf265b52c53.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249787,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec5e3f79bd0749fdbd589b950fba1511.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302937,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3d7ae4d61b38474b9ee29d29f1e2bffb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237378,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3b8befeaeef4cdcbc9d160e4d6502cd.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217711,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f581e951cf9b495f9a1aecf8380e8ed2.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201049,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/20d3b35cb27a4510b9e1a8c7b02cddd8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196882,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eff458d6406247c58c33607e7f78ccbb.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290684,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53557776a8f5450583e4c438aeeb9594.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201825,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a58fc94c26a4338b249638600a9ddc8.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182456,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0acc19107a2d4e619e95e3c63971dfb0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ca3c21-140b-5d0f-943c-5528149694fc/a9ca3c21-140b-5d0f-943c-5528149694fc_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152600,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b80376d7b09f41c48d3fc20a2fae2557.jpg',
'Width': 1600}],
'price': 2999,
'price_includes_vat': True,
'registration_date': '2009-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Freelander 2 2.2 TD4 GS 4WD Euro 4 5dr',
'transmission': 'manual',
'trim': 'GS',
'year': 2009}
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258138891%27 HTTP/1.1" 200 None
2025-12-05 12:58:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258138891: {'created_time': 1764939512.336293, 'last_price_update_time': 1764939512.336302}
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258138891') HTTP/1.1" 204 0
2025-12-05 12:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:33 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent runner, top version, 2 keys, spacious car, amazing '
'mileage per gallon, full service history, recently serviced, '
'comes with 3 months warranty,12 months AA breakdown cover, '
'new mot, we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 197,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258137819',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Jaguar',
'model': 'XF',
'odometer': 118840,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/759045e8b4584460835ebb16d303e8f4.jpg',
'https://m.atcdn.co.uk/a/media/bdd9444512a443c08af3e48a9182f52e.jpg',
'https://m.atcdn.co.uk/a/media/3569968f039c4fdb9f9d36a1d11f8aae.jpg',
'https://m.atcdn.co.uk/a/media/cf0a3a5df1594948a7203e83f6b7788f.jpg',
'https://m.atcdn.co.uk/a/media/d60529385561462183039a0612e22b96.jpg',
'https://m.atcdn.co.uk/a/media/ed70ea40199e4f41b6bc33de515127ab.jpg',
'https://m.atcdn.co.uk/a/media/4eae7fcaf9d14626b8da611ee76f4446.jpg',
'https://m.atcdn.co.uk/a/media/50124c27e2874e629b58bdd37edee9a2.jpg',
'https://m.atcdn.co.uk/a/media/bcd53f8bf3d841bfb3e24a1395b73aba.jpg',
'https://m.atcdn.co.uk/a/media/d5249bb7d3f24ae2a32dbbcdfc380a70.jpg',
'https://m.atcdn.co.uk/a/media/d91af1ffb00044c2a19e45c535b0ce0f.jpg',
'https://m.atcdn.co.uk/a/media/1b44500479214b11b40c109b84848851.jpg',
'https://m.atcdn.co.uk/a/media/7525911b03074ae1b4f2ccc3e8be1fde.jpg'],
'price': 4999,
'price_includes_vat': True,
'registration_date': '2013-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XF 2.2d Luxury Sportbrake Auto Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2013}
2025-12-05 12:58:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e91d4b78-d712-5a9b-b977-358fa4e7de86 with identifier: 202511258137819
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e91d4b78-d712-5a9b-b977-358fa4e7de86
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F759045e8b4584460835ebb16d303e8f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/759045e8b4584460835ebb16d303e8f4.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbdd9444512a443c08af3e48a9182f52e.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bdd9444512a443c08af3e48a9182f52e.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3569968f039c4fdb9f9d36a1d11f8aae.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3569968f039c4fdb9f9d36a1d11f8aae.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf0a3a5df1594948a7203e83f6b7788f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf0a3a5df1594948a7203e83f6b7788f.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd60529385561462183039a0612e22b96.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d60529385561462183039a0612e22b96.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed70ea40199e4f41b6bc33de515127ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed70ea40199e4f41b6bc33de515127ab.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4eae7fcaf9d14626b8da611ee76f4446.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4eae7fcaf9d14626b8da611ee76f4446.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F50124c27e2874e629b58bdd37edee9a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/50124c27e2874e629b58bdd37edee9a2.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbcd53f8bf3d841bfb3e24a1395b73aba.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bcd53f8bf3d841bfb3e24a1395b73aba.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd5249bb7d3f24ae2a32dbbcdfc380a70.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d5249bb7d3f24ae2a32dbbcdfc380a70.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd91af1ffb00044c2a19e45c535b0ce0f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d91af1ffb00044c2a19e45c535b0ce0f.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b44500479214b11b40c109b84848851.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b44500479214b11b40c109b84848851.jpg already downloaded
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7525911b03074ae1b4f2ccc3e8be1fde.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7525911b03074ae1b4f2ccc3e8be1fde.jpg already downloaded
2025-12-05 12:58:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e91d4b78-d712-5a9b-b977-358fa4e7de86 with identifier 202511258137819
2025-12-05 12:58:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e91d4b78-d712-5a9b-b977-358fa4e7de86
2025-12-05 12:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'White',
'currency': 'GBP',
'description': 'Excellent runner, top version, 2 keys, spacious car, amazing '
'mileage per gallon, full service history, recently serviced, '
'comes with 3 months warranty,12 months AA breakdown cover, '
'new mot, we accept all card payments',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 197,
'fuel_type': 'Diesel',
'id': 'e91d4b78-d712-5a9b-b977-358fa4e7de86',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258137819',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Jaguar',
'model': 'XF',
'odometer': 118840,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/759045e8b4584460835ebb16d303e8f4.jpg',
'https://m.atcdn.co.uk/a/media/bdd9444512a443c08af3e48a9182f52e.jpg',
'https://m.atcdn.co.uk/a/media/3569968f039c4fdb9f9d36a1d11f8aae.jpg',
'https://m.atcdn.co.uk/a/media/cf0a3a5df1594948a7203e83f6b7788f.jpg',
'https://m.atcdn.co.uk/a/media/d60529385561462183039a0612e22b96.jpg',
'https://m.atcdn.co.uk/a/media/ed70ea40199e4f41b6bc33de515127ab.jpg',
'https://m.atcdn.co.uk/a/media/4eae7fcaf9d14626b8da611ee76f4446.jpg',
'https://m.atcdn.co.uk/a/media/50124c27e2874e629b58bdd37edee9a2.jpg',
'https://m.atcdn.co.uk/a/media/bcd53f8bf3d841bfb3e24a1395b73aba.jpg',
'https://m.atcdn.co.uk/a/media/d5249bb7d3f24ae2a32dbbcdfc380a70.jpg',
'https://m.atcdn.co.uk/a/media/d91af1ffb00044c2a19e45c535b0ce0f.jpg',
'https://m.atcdn.co.uk/a/media/1b44500479214b11b40c109b84848851.jpg',
'https://m.atcdn.co.uk/a/media/7525911b03074ae1b4f2ccc3e8be1fde.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201723,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/759045e8b4584460835ebb16d303e8f4.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232307,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bdd9444512a443c08af3e48a9182f52e.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253096,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3569968f039c4fdb9f9d36a1d11f8aae.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259910,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf0a3a5df1594948a7203e83f6b7788f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287340,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d60529385561462183039a0612e22b96.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193507,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed70ea40199e4f41b6bc33de515127ab.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100491,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4eae7fcaf9d14626b8da611ee76f4446.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137917,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/50124c27e2874e629b58bdd37edee9a2.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240052,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bcd53f8bf3d841bfb3e24a1395b73aba.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126747,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d5249bb7d3f24ae2a32dbbcdfc380a70.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127296,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d91af1ffb00044c2a19e45c535b0ce0f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134546,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b44500479214b11b40c109b84848851.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc21136-bd80-5f10-8094-477936694603/9dc21136-bd80-5f10-8094-477936694603_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152458,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7525911b03074ae1b4f2ccc3e8be1fde.jpg',
'Width': 1600}],
'price': 4999,
'price_includes_vat': True,
'registration_date': '2013-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XF 2.2d Luxury Sportbrake Auto Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2013}
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258137819%27 HTTP/1.1" 200 None
2025-12-05 12:58:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258137819: {'created_time': 1764939513.513367, 'last_price_update_time': 1764939513.51338}
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258137819') HTTP/1.1" 204 0
2025-12-05 12:58:37 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 9 pages/min), scraped 35 items (at 9 items/min)
2025-12-05 12:58:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.593(s), this was the 1st time calling it.
2025-12-05 12:58:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.797396075243524 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 12:58:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 12:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:58:56 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent condition,top version, clean car, sports '
'version,amazing mileage per gallon,low tax and insurance '
'group, comes with 3 months warranty,12 months AA breakdown '
'cover',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 180,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306772283',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Abarth',
'model': '595',
'odometer': 43139,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/eea955c89f2b4584ba20383a0ee64784.jpg',
'https://m.atcdn.co.uk/a/media/3e3b10a780364e06b72f58d78a923831.jpg',
'https://m.atcdn.co.uk/a/media/3a97e42356dd4bef92b08b923e45a59c.jpg',
'https://m.atcdn.co.uk/a/media/ec00e49e336c496a884cf6a2de3dc56c.jpg',
'https://m.atcdn.co.uk/a/media/01365be7ef574829a7cbb439f02d649f.jpg',
'https://m.atcdn.co.uk/a/media/44f0c59c46c041b2888cf1d1efbaedec.jpg',
'https://m.atcdn.co.uk/a/media/05bd0b3657d247a38456b47e0038a1c1.jpg',
'https://m.atcdn.co.uk/a/media/e8c2b2f971924b539231f756ed1bba37.jpg',
'https://m.atcdn.co.uk/a/media/08fd59499c344992a21264578f117a20.jpg',
'https://m.atcdn.co.uk/a/media/8100cdf3a780441b8170edbdfb3119e7.jpg',
'https://m.atcdn.co.uk/a/media/09a5992ff1c241eeadfbcd5f5ce90709.jpg',
'https://m.atcdn.co.uk/a/media/50d2b5d77b3240e7b69766882145cc32.jpg',
'https://m.atcdn.co.uk/a/media/83464324ddde485cb20032ea5cecee82.jpg'],
'price': 8499,
'price_includes_vat': True,
'registration_date': '2015-09-15',
'seats_number': 4,
'seller_name': None,
'title': 'Abarth 595 1.4 T-Jet Competizione Euro 6 3dr',
'transmission': 'manual',
'trim': 'Competizione',
'year': 2015}
2025-12-05 12:58:56 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c32154ec-aa2d-55b5-8726-481f152b6c0c with identifier: 202509306772283
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item c32154ec-aa2d-55b5-8726-481f152b6c0c
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feea955c89f2b4584ba20383a0ee64784.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eea955c89f2b4584ba20383a0ee64784.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e3b10a780364e06b72f58d78a923831.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e3b10a780364e06b72f58d78a923831.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a97e42356dd4bef92b08b923e45a59c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a97e42356dd4bef92b08b923e45a59c.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec00e49e336c496a884cf6a2de3dc56c.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec00e49e336c496a884cf6a2de3dc56c.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01365be7ef574829a7cbb439f02d649f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01365be7ef574829a7cbb439f02d649f.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44f0c59c46c041b2888cf1d1efbaedec.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44f0c59c46c041b2888cf1d1efbaedec.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05bd0b3657d247a38456b47e0038a1c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05bd0b3657d247a38456b47e0038a1c1.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe8c2b2f971924b539231f756ed1bba37.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e8c2b2f971924b539231f756ed1bba37.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F08fd59499c344992a21264578f117a20.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/08fd59499c344992a21264578f117a20.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8100cdf3a780441b8170edbdfb3119e7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8100cdf3a780441b8170edbdfb3119e7.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09a5992ff1c241eeadfbcd5f5ce90709.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09a5992ff1c241eeadfbcd5f5ce90709.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F50d2b5d77b3240e7b69766882145cc32.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/50d2b5d77b3240e7b69766882145cc32.jpg already downloaded
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83464324ddde485cb20032ea5cecee82.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83464324ddde485cb20032ea5cecee82.jpg already downloaded
2025-12-05 12:58:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c32154ec-aa2d-55b5-8726-481f152b6c0c with identifier 202509306772283
2025-12-05 12:58:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:58:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c32154ec-aa2d-55b5-8726-481f152b6c0c
2025-12-05 12:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Grey',
'currency': 'GBP',
'description': 'Excellent condition,top version, clean car, sports '
'version,amazing mileage per gallon,low tax and insurance '
'group, comes with 3 months warranty,12 months AA breakdown '
'cover',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 180,
'fuel_type': 'Petrol',
'id': 'c32154ec-aa2d-55b5-8726-481f152b6c0c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306772283',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Abarth',
'model': '595',
'odometer': 43139,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/eea955c89f2b4584ba20383a0ee64784.jpg',
'https://m.atcdn.co.uk/a/media/3e3b10a780364e06b72f58d78a923831.jpg',
'https://m.atcdn.co.uk/a/media/3a97e42356dd4bef92b08b923e45a59c.jpg',
'https://m.atcdn.co.uk/a/media/ec00e49e336c496a884cf6a2de3dc56c.jpg',
'https://m.atcdn.co.uk/a/media/01365be7ef574829a7cbb439f02d649f.jpg',
'https://m.atcdn.co.uk/a/media/44f0c59c46c041b2888cf1d1efbaedec.jpg',
'https://m.atcdn.co.uk/a/media/05bd0b3657d247a38456b47e0038a1c1.jpg',
'https://m.atcdn.co.uk/a/media/e8c2b2f971924b539231f756ed1bba37.jpg',
'https://m.atcdn.co.uk/a/media/08fd59499c344992a21264578f117a20.jpg',
'https://m.atcdn.co.uk/a/media/8100cdf3a780441b8170edbdfb3119e7.jpg',
'https://m.atcdn.co.uk/a/media/09a5992ff1c241eeadfbcd5f5ce90709.jpg',
'https://m.atcdn.co.uk/a/media/50d2b5d77b3240e7b69766882145cc32.jpg',
'https://m.atcdn.co.uk/a/media/83464324ddde485cb20032ea5cecee82.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238101,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e3b10a780364e06b72f58d78a923831.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196160,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eea955c89f2b4584ba20383a0ee64784.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284647,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a97e42356dd4bef92b08b923e45a59c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182883,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec00e49e336c496a884cf6a2de3dc56c.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153686,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/01365be7ef574829a7cbb439f02d649f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121626,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/44f0c59c46c041b2888cf1d1efbaedec.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192680,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/05bd0b3657d247a38456b47e0038a1c1.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171021,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e8c2b2f971924b539231f756ed1bba37.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229887,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/08fd59499c344992a21264578f117a20.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187915,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8100cdf3a780441b8170edbdfb3119e7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252476,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09a5992ff1c241eeadfbcd5f5ce90709.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99942,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/50d2b5d77b3240e7b69766882145cc32.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9376ee3-333f-50b6-8a05-05b4819de616/a9376ee3-333f-50b6-8a05-05b4819de616_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257255,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/83464324ddde485cb20032ea5cecee82.jpg',
'Width': 1600}],
'price': 8499,
'price_includes_vat': True,
'registration_date': '2015-09-15',
'seats_number': 4,
'seller_name': None,
'title': 'Abarth 595 1.4 T-Jet Competizione Euro 6 3dr',
'transmission': 'manual',
'trim': 'Competizione',
'year': 2015}
2025-12-05 12:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306772283%27 HTTP/1.1" 200 None
2025-12-05 12:58:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509306772283: {'created_time': 1764939537.153289, 'last_price_update_time': 1764939537.1533}
2025-12-05 12:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509306772283') HTTP/1.1" 204 0
2025-12-05 12:59:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.217(s), this was the 1st time calling it.
2025-12-05 12:59:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.048007493093862 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 12:59:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 12:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 12:59:24 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner, recently serviced, service history, low tax '
'and insurance group,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1L',
'engine_horse_power': 67,
'fuel_type': 'Petrol',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510207293374',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Peugeot',
'model': '107',
'odometer': 118200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/dd4fc954f7c04a369d99c6574a80af26.jpg',
'https://m.atcdn.co.uk/a/media/f1892b131af44dc8b49677ad4e38dce4.jpg',
'https://m.atcdn.co.uk/a/media/2480003848cd430fac0169516cd7b816.jpg',
'https://m.atcdn.co.uk/a/media/f2f1abd46c534a319f5de1efe99c6da7.jpg',
'https://m.atcdn.co.uk/a/media/6d4ef228315c41c39ea336688c8ab610.jpg',
'https://m.atcdn.co.uk/a/media/9827abea19814135bc5f660bd0ff9014.jpg',
'https://m.atcdn.co.uk/a/media/81f4b9d6a5854fd1bebb98f6305c0c16.jpg',
'https://m.atcdn.co.uk/a/media/0b8b3ae1d80a40ddaf4810f6d74f4f73.jpg',
'https://m.atcdn.co.uk/a/media/847d2fe96daf461fbfed0ea30e947809.jpg',
'https://m.atcdn.co.uk/a/media/cccd5ee1c14e4205a49f820f0c4b9091.jpg',
'https://m.atcdn.co.uk/a/media/4121be21b67b4f8c8325e698acfa7f78.jpg',
'https://m.atcdn.co.uk/a/media/392fed65d2694f73b5e3eac63fd8859f.jpg',
'https://m.atcdn.co.uk/a/media/c9c9ec39eb1d411f854d6fa3af74d497.jpg'],
'price': 1299,
'price_includes_vat': True,
'registration_date': '2009-01-31',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 107 1.0 12V Verve Euro 4 5dr',
'transmission': 'manual',
'trim': 'Verve',
'year': 2009}
2025-12-05 12:59:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e4f8b983-3e81-568d-aaaa-53b24d7da47f with identifier: 202510207293374
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e4f8b983-3e81-568d-aaaa-53b24d7da47f
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd4fc954f7c04a369d99c6574a80af26.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd4fc954f7c04a369d99c6574a80af26.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff1892b131af44dc8b49677ad4e38dce4.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f1892b131af44dc8b49677ad4e38dce4.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2480003848cd430fac0169516cd7b816.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2480003848cd430fac0169516cd7b816.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2f1abd46c534a319f5de1efe99c6da7.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2f1abd46c534a319f5de1efe99c6da7.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d4ef228315c41c39ea336688c8ab610.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d4ef228315c41c39ea336688c8ab610.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9827abea19814135bc5f660bd0ff9014.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9827abea19814135bc5f660bd0ff9014.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F81f4b9d6a5854fd1bebb98f6305c0c16.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/81f4b9d6a5854fd1bebb98f6305c0c16.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b8b3ae1d80a40ddaf4810f6d74f4f73.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b8b3ae1d80a40ddaf4810f6d74f4f73.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F847d2fe96daf461fbfed0ea30e947809.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/847d2fe96daf461fbfed0ea30e947809.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcccd5ee1c14e4205a49f820f0c4b9091.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cccd5ee1c14e4205a49f820f0c4b9091.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4121be21b67b4f8c8325e698acfa7f78.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4121be21b67b4f8c8325e698acfa7f78.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F392fed65d2694f73b5e3eac63fd8859f.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/392fed65d2694f73b5e3eac63fd8859f.jpg already downloaded
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9c9ec39eb1d411f854d6fa3af74d497.jpg%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9c9ec39eb1d411f854d6fa3af74d497.jpg already downloaded
2025-12-05 12:59:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e4f8b983-3e81-568d-aaaa-53b24d7da47f with identifier 202510207293374
2025-12-05 12:59:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:59:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:59:24 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e4f8b983-3e81-568d-aaaa-53b24d7da47f
2025-12-05 12:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'Red',
'currency': 'GBP',
'description': 'Excellent runner, recently serviced, service history, low tax '
'and insurance group,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1L',
'engine_horse_power': 67,
'fuel_type': 'Petrol',
'id': 'e4f8b983-3e81-568d-aaaa-53b24d7da47f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510207293374',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Peugeot',
'model': '107',
'odometer': 118200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/dd4fc954f7c04a369d99c6574a80af26.jpg',
'https://m.atcdn.co.uk/a/media/f1892b131af44dc8b49677ad4e38dce4.jpg',
'https://m.atcdn.co.uk/a/media/2480003848cd430fac0169516cd7b816.jpg',
'https://m.atcdn.co.uk/a/media/f2f1abd46c534a319f5de1efe99c6da7.jpg',
'https://m.atcdn.co.uk/a/media/6d4ef228315c41c39ea336688c8ab610.jpg',
'https://m.atcdn.co.uk/a/media/9827abea19814135bc5f660bd0ff9014.jpg',
'https://m.atcdn.co.uk/a/media/81f4b9d6a5854fd1bebb98f6305c0c16.jpg',
'https://m.atcdn.co.uk/a/media/0b8b3ae1d80a40ddaf4810f6d74f4f73.jpg',
'https://m.atcdn.co.uk/a/media/847d2fe96daf461fbfed0ea30e947809.jpg',
'https://m.atcdn.co.uk/a/media/cccd5ee1c14e4205a49f820f0c4b9091.jpg',
'https://m.atcdn.co.uk/a/media/4121be21b67b4f8c8325e698acfa7f78.jpg',
'https://m.atcdn.co.uk/a/media/392fed65d2694f73b5e3eac63fd8859f.jpg',
'https://m.atcdn.co.uk/a/media/c9c9ec39eb1d411f854d6fa3af74d497.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236271,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dd4fc954f7c04a369d99c6574a80af26.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252368,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f1892b131af44dc8b49677ad4e38dce4.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230565,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2480003848cd430fac0169516cd7b816.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220363,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2f1abd46c534a319f5de1efe99c6da7.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237290,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d4ef228315c41c39ea336688c8ab610.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210238,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9827abea19814135bc5f660bd0ff9014.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150436,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/81f4b9d6a5854fd1bebb98f6305c0c16.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186932,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b8b3ae1d80a40ddaf4810f6d74f4f73.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176597,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/847d2fe96daf461fbfed0ea30e947809.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215341,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cccd5ee1c14e4205a49f820f0c4b9091.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186960,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4121be21b67b4f8c8325e698acfa7f78.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125715,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/392fed65d2694f73b5e3eac63fd8859f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a42b808c-1ef1-55b3-a88a-f41c3feeb68b/a42b808c-1ef1-55b3-a88a-f41c3feeb68b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153967,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9c9ec39eb1d411f854d6fa3af74d497.jpg',
'Width': 1600}],
'price': 1299,
'price_includes_vat': True,
'registration_date': '2009-01-31',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 107 1.0 12V Verve Euro 4 5dr',
'transmission': 'manual',
'trim': 'Verve',
'year': 2009}
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510207293374%27 HTTP/1.1" 200 None
2025-12-05 12:59:24 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510207293374: {'created_time': 1764939564.679177, 'last_price_update_time': 1764939564.679188}
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510207293374') HTTP/1.1" 204 0
2025-12-05 12:59:37 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 2 pages/min), scraped 37 items (at 2 items/min)
2025-12-05 12:59:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.105(s), this was the 1st time calling it.
2025-12-05 12:59:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.967138208557046 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 13:00:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 13:00:37 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 0 pages/min), scraped 37 items (at 0 items/min)
2025-12-05 13:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2025-12-05 13:00:39 [auto_selling_autotrader.co.uk] INFO: Extracted item: {'auction_title': '',
'c_o_2_emission_value': 165,
'color': 'Silver',
'currency': 'GBP',
'description': 'Clean car, automatic, spacious car, recently serviced,service '
'history,comes with new mot,1 month warranty,12 months AA '
'breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258137783',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 130121,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d40d4d1ca2fe43e092fe007825e60544.jpg',
'https://m.atcdn.co.uk/a/media/aa7e97a6e40f4b9bacbfa106889216ba.jpg',
'https://m.atcdn.co.uk/a/media/a05861e333f64cd186b6ecd01f9d662b.jpg',
'https://m.atcdn.co.uk/a/media/11fcd1bbde5d42e78ccc58e8ecfaea6f.jpg',
'https://m.atcdn.co.uk/a/media/609995c4d7c340959178f4addf496b16.jpg',
'https://m.atcdn.co.uk/a/media/dd2ae79bbd614830b19d46ad28ff7962.jpg',
'https://m.atcdn.co.uk/a/media/79b1891c0da04940af32c580c3c0d5e0.jpg',
'https://m.atcdn.co.uk/a/media/26cd254e8435495d8c2be4295d4da1d1.jpg',
'https://m.atcdn.co.uk/a/media/fbb62ddb6b4742dd81f29170890c57c0.jpg',
'https://m.atcdn.co.uk/a/media/0c3f11703d244a8b8d2bc6a4747ba899.jpg',
'https://m.atcdn.co.uk/a/media/0c950eb08da24382bf83bdad6f688051.jpg',
'https://m.atcdn.co.uk/a/media/5bf54433dbe44795b579f7c47d23b961.jpg',
'https://m.atcdn.co.uk/a/media/090f488b2a384a1fb3da9d878b357ae3.jpg'],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2008-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline DSG Euro 4 5dr',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2008}
2025-12-05 13:00:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fe4f7a69-c5e6-5c5d-b6f7-53230cb7c8be with identifier: 202511258137783
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item fe4f7a69-c5e6-5c5d-b6f7-53230cb7c8be
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd40d4d1ca2fe43e092fe007825e60544.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d40d4d1ca2fe43e092fe007825e60544.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa7e97a6e40f4b9bacbfa106889216ba.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa7e97a6e40f4b9bacbfa106889216ba.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa05861e333f64cd186b6ecd01f9d662b.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a05861e333f64cd186b6ecd01f9d662b.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11fcd1bbde5d42e78ccc58e8ecfaea6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11fcd1bbde5d42e78ccc58e8ecfaea6f.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F609995c4d7c340959178f4addf496b16.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/609995c4d7c340959178f4addf496b16.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd2ae79bbd614830b19d46ad28ff7962.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd2ae79bbd614830b19d46ad28ff7962.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79b1891c0da04940af32c580c3c0d5e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79b1891c0da04940af32c580c3c0d5e0.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26cd254e8435495d8c2be4295d4da1d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26cd254e8435495d8c2be4295d4da1d1.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffbb62ddb6b4742dd81f29170890c57c0.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fbb62ddb6b4742dd81f29170890c57c0.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c3f11703d244a8b8d2bc6a4747ba899.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c3f11703d244a8b8d2bc6a4747ba899.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c950eb08da24382bf83bdad6f688051.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c950eb08da24382bf83bdad6f688051.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5bf54433dbe44795b579f7c47d23b961.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5bf54433dbe44795b579f7c47d23b961.jpg already downloaded
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F090f488b2a384a1fb3da9d878b357ae3.jpg%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/090f488b2a384a1fb3da9d878b357ae3.jpg already downloaded
2025-12-05 13:00:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fe4f7a69-c5e6-5c5d-b6f7-53230cb7c8be with identifier 202511258137783
2025-12-05 13:00:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 13:00:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 13:00:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fe4f7a69-c5e6-5c5d-b6f7-53230cb7c8be
2025-12-05 13:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 165,
'color': 'Silver',
'currency': 'GBP',
'description': 'Clean car, automatic, spacious car, recently serviced,service '
'history,comes with new mot,1 month warranty,12 months AA '
'breakdown cover',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'id': 'fe4f7a69-c5e6-5c5d-b6f7-53230cb7c8be',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258137783',
'listing': 'directbuy',
'location': 'Highbridge, Somerset',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 130121,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d40d4d1ca2fe43e092fe007825e60544.jpg',
'https://m.atcdn.co.uk/a/media/aa7e97a6e40f4b9bacbfa106889216ba.jpg',
'https://m.atcdn.co.uk/a/media/a05861e333f64cd186b6ecd01f9d662b.jpg',
'https://m.atcdn.co.uk/a/media/11fcd1bbde5d42e78ccc58e8ecfaea6f.jpg',
'https://m.atcdn.co.uk/a/media/609995c4d7c340959178f4addf496b16.jpg',
'https://m.atcdn.co.uk/a/media/dd2ae79bbd614830b19d46ad28ff7962.jpg',
'https://m.atcdn.co.uk/a/media/79b1891c0da04940af32c580c3c0d5e0.jpg',
'https://m.atcdn.co.uk/a/media/26cd254e8435495d8c2be4295d4da1d1.jpg',
'https://m.atcdn.co.uk/a/media/fbb62ddb6b4742dd81f29170890c57c0.jpg',
'https://m.atcdn.co.uk/a/media/0c3f11703d244a8b8d2bc6a4747ba899.jpg',
'https://m.atcdn.co.uk/a/media/0c950eb08da24382bf83bdad6f688051.jpg',
'https://m.atcdn.co.uk/a/media/5bf54433dbe44795b579f7c47d23b961.jpg',
'https://m.atcdn.co.uk/a/media/090f488b2a384a1fb3da9d878b357ae3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220159,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d40d4d1ca2fe43e092fe007825e60544.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261425,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa7e97a6e40f4b9bacbfa106889216ba.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224869,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a05861e333f64cd186b6ecd01f9d662b.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263476,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11fcd1bbde5d42e78ccc58e8ecfaea6f.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171984,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/609995c4d7c340959178f4addf496b16.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121826,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dd2ae79bbd614830b19d46ad28ff7962.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236683,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79b1891c0da04940af32c580c3c0d5e0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133134,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26cd254e8435495d8c2be4295d4da1d1.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137353,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fbb62ddb6b4742dd81f29170890c57c0.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140776,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c3f11703d244a8b8d2bc6a4747ba899.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155290,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c950eb08da24382bf83bdad6f688051.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81813,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5bf54433dbe44795b579f7c47d23b961.jpg',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e40c9a5d-236c-5728-83c3-5a827e8f4f7b/e40c9a5d-236c-5728-83c3-5a827e8f4f7b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246946,
'Height': 900,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/090f488b2a384a1fb3da9d878b357ae3.jpg',
'Width': 1600}],
'price': 1799,
'price_includes_vat': True,
'registration_date': '2008-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline DSG Euro 4 5dr',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2008}
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258137783%27 HTTP/1.1" 200 None
2025-12-05 13:00:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258137783: {'created_time': 1764939639.608025, 'last_price_update_time': 1764939639.608036}
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258137783') HTTP/1.1" 204 0
2025-12-05 13:00:39 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 13:00:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2025-12-05 13:00:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2025-12-05 13:00:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 13:00:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 13:00:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 3175e3e0d1c111f0b120928152083da5
2025-12-05 13:00:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2025-12-05 13:00:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2025-12-05 13:00:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 13:00:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 13:00:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2025-12-05 13:00:40 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-05 13:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 13:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201763643640 HTTP/1.1" 200 None
2025-12-05 13:00:40 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (38 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/3175e3e0d1c111f0b120928152083da5.jl
2025-12-05 13:00:40 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 307292,
'downloader/request_count': 40,
'downloader/request_method_count/POST': 40,
'downloader/response_bytes': 1331849,
'downloader/response_count': 40,
'downloader/response_status_count/200': 40,
'elapsed_time_seconds': 302.855829,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2025, 12, 5, 13, 0, 40, 289127, tzinfo=datetime.timezone.utc),
'item_scraped_count': 38,
'log_count/DEBUG': 1466,
'log_count/INFO': 818,
'memusage/max': 147501056,
'memusage/startup': 126701568,
'request_depth_max': 2,
'response_received_count': 40,
'scheduler/dequeued': 40,
'scheduler/dequeued/memory': 40,
'scheduler/enqueued': 40,
'scheduler/enqueued/memory': 40,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 44,
'scrapy-zyte-api/error_ratio': 0.09090909090909091,
'scrapy-zyte-api/errors': 4,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 4,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 10.635016410431128,
'scrapy-zyte-api/mean_response_seconds': 10.66001906126039,
'scrapy-zyte-api/processed': 40,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 40,
'scrapy-zyte-api/request_args/experimental.requestCookies': 39,
'scrapy-zyte-api/request_args/experimental.responseCookies': 40,
'scrapy-zyte-api/request_args/httpRequestBody': 40,
'scrapy-zyte-api/request_args/httpRequestMethod': 40,
'scrapy-zyte-api/request_args/httpResponseBody': 40,
'scrapy-zyte-api/request_args/httpResponseHeaders': 40,
'scrapy-zyte-api/request_args/url': 40,
'scrapy-zyte-api/status_codes/0': 4,
'scrapy-zyte-api/status_codes/200': 40,
'scrapy-zyte-api/success': 40,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2025, 12, 5, 12, 55, 37, 433298, tzinfo=datetime.timezone.utc)}
2025-12-05 13:00:40 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 13:00:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0376133710>
2025-12-05 13:00:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0376139550>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)